Apr 17 15:19:20 user nova-compute[82617]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 17 15:19:23 user nova-compute[82617]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=82617) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 17 15:19:23 user nova-compute[82617]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=82617) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 17 15:19:23 user nova-compute[82617]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=82617) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 17 15:19:23 user nova-compute[82617]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 17 15:19:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:19:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.030s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:19:24 user nova-compute[82617]: INFO nova.virt.driver [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 17 15:19:24 user nova-compute[82617]: INFO nova.compute.provider_config [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] Acquiring lock "singleton_lock" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] Acquired lock "singleton_lock" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] Releasing lock "singleton_lock" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] Full set of CONF: {{(pid=82617) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ******************************************************************************** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] Configuration options gathered from: {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ================================================================================ {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] allow_resize_to_same_host      = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] arq_binding_timeout            = 300 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] backdoor_port                  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] backdoor_socket                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] block_device_allocate_retries  = 300 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] block_device_allocate_retries_interval = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cert                           = self.pem {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute_monitors               = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] config_dir                     = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] config_drive_format            = iso9660 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] config_source                  = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] console_host                   = user {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] control_exchange               = nova {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cpu_allocation_ratio           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] daemon                         = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] debug                          = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] default_access_ip_network_name = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] default_availability_zone      = nova {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] default_ephemeral_format       = ext4 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] default_schedule_zone          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] disk_allocation_ratio          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] enable_new_services            = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] enabled_apis                   = ['osapi_compute'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] enabled_ssl_apis               = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] flat_injected                  = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] force_config_drive             = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] force_raw_images               = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] graceful_shutdown_timeout      = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] heal_instance_info_cache_interval = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] host                           = user {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] instance_build_timeout         = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] instance_delete_interval       = 300 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] instance_name_template         = instance-%08x {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] instance_usage_audit           = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] instance_usage_audit_period    = month {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] internal_service_availability_zone = internal {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] key                            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] live_migration_retry_count     = 30 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] log_config_append              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] log_dir                        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] log_file                       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] log_options                    = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] log_rotate_interval            = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] log_rotate_interval_type       = days {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] log_rotation_type              = none {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] long_rpc_timeout               = 1800 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] max_concurrent_builds          = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] max_concurrent_live_migrations = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] max_concurrent_snapshots       = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] max_local_block_devices        = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] max_logfile_count              = 30 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] max_logfile_size_mb            = 200 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] maximum_instance_delete_attempts = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] metadata_listen                = 0.0.0.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] metadata_listen_port           = 8775 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] metadata_workers               = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] migrate_max_retries            = -1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] mkisofs_cmd                    = genisoimage {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] my_ip                          = 10.0.0.210 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] network_allocate_retries       = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] osapi_compute_listen_port      = 8774 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] osapi_compute_unique_server_name_scope =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] osapi_compute_workers          = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] password_length                = 12 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] periodic_enable                = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] periodic_fuzzy_delay           = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] pointer_model                  = ps2mouse {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] preallocate_images             = none {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] publish_errors                 = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] pybasedir                      = /opt/stack/nova {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ram_allocation_ratio           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] rate_limit_burst               = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] rate_limit_except_level        = CRITICAL {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] rate_limit_interval            = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] reboot_timeout                 = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] reclaim_instance_interval      = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] record                         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] reimage_timeout_per_gb         = 20 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] report_interval                = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] rescue_timeout                 = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] reserved_host_cpus             = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] reserved_host_disk_mb          = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] reserved_host_memory_mb        = 512 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] reserved_huge_pages            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] resize_confirm_window          = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] resize_fs_using_block_device   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] resume_guests_state_on_host_boot = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] rpc_response_timeout           = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] run_external_periodic_tasks    = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] running_deleted_instance_action = reap {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] running_deleted_instance_poll_interval = 1800 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] running_deleted_instance_timeout = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler_instance_sync_interval = 120 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_down_time              = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] servicegroup_driver            = db {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] shelved_offload_time           = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] shelved_poll_interval          = 3600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] shutdown_timeout               = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] source_is_ipv6                 = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ssl_only                       = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] state_path                     = /opt/stack/data/nova {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] sync_power_state_interval      = 600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] sync_power_state_pool_size     = 1000 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] syslog_log_facility            = LOG_USER {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] tempdir                        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] timeout_nbd                    = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] transport_url                  = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] update_resources_interval      = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] use_cow_images                 = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] use_eventlog                   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] use_journal                    = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] use_json                       = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] use_rootwrap_daemon            = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] use_stderr                     = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] use_syslog                     = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vcpu_pin_set                   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plugging_is_fatal          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plugging_timeout           = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] virt_mkfs                      = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] volume_usage_poll_interval     = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] watch_log_file                 = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] web                            = /usr/share/spice-html5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_concurrency.disable_process_locking = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.auth_strategy              = keystone {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.compute_link_prefix        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.dhcp_domain                = novalocal {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.enable_instance_password   = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.glance_link_prefix         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.instance_list_per_project_cells = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.list_records_by_skipping_down_cells = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.local_metadata_per_cell    = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.max_limit                  = 1000 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.metadata_cache_expiration  = 15 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.neutron_default_tenant_id  = default {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.use_forwarded_for          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.use_neutron_default_nets   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.vendordata_dynamic_targets = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.vendordata_jsonfile_path   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.backend                  = dogpile.cache.memcached {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.backend_argument         = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.config_prefix            = cache.oslo {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.dead_timeout             = 60.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.debug_cache_backend      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.enable_retry_client      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.enable_socket_keepalive  = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.enabled                  = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.expiration_time          = 600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.hashclient_retry_attempts = 2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_dead_retry      = 300 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_password        =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_sasl_enabled    = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.memcache_username        =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.proxies                  = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.retry_attempts           = 2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.retry_delay              = 0.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.socket_keepalive_count   = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.socket_keepalive_idle    = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.socket_keepalive_interval = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.tls_allowed_ciphers      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.tls_cafile               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.tls_certfile             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.tls_enabled              = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cache.tls_keyfile              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.auth_section            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.auth_type               = password {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.cafile                  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.certfile                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.collect_timing          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.cross_az_attach         = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.debug                   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.endpoint_template       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.http_retries            = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.insecure                = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.keyfile                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.os_region_name          = RegionOne {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.split_loggers           = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cinder.timeout                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.cpu_dedicated_set      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.cpu_shared_set         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.image_type_exclude_list = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.max_concurrent_disk_ops = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.max_disk_devices_to_attach = -1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.resource_provider_association_refresh = 300 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.shutdown_retry_interval = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] conductor.workers              = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] console.allowed_origins        = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] console.ssl_ciphers            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] console.ssl_minimum_version    = default {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] consoleauth.token_ttl          = 600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.cafile                  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.certfile                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.collect_timing          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.connect_retries         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.connect_retry_delay     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.endpoint_override       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.insecure                = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.keyfile                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.max_version             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.min_version             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.region_name             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.service_name            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.service_type            = accelerator {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.split_loggers           = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.status_code_retries     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.status_code_retry_delay = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.timeout                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] cyborg.version                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.backend               = sqlalchemy {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.connection            = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.connection_debug      = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.connection_parameters =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.connection_recycle_time = 3600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.connection_trace      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.db_inc_retry_interval = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.db_max_retries        = 20 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.db_max_retry_interval = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.db_retry_interval     = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.max_overflow          = 50 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.max_pool_size         = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.max_retries           = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.mysql_enable_ndb      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.mysql_wsrep_sync_wait = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.pool_timeout          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.retry_interval        = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.slave_connection      = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] database.sqlite_synchronous    = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.backend           = sqlalchemy {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.connection        = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.connection_debug  = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.connection_parameters =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.connection_recycle_time = 3600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.connection_trace  = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.db_inc_retry_interval = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.db_max_retries    = 20 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.db_max_retry_interval = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.db_retry_interval = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.max_overflow      = 50 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.max_pool_size     = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.max_retries       = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.mysql_enable_ndb  = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.pool_timeout      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.retry_interval    = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.slave_connection  = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] api_database.sqlite_synchronous = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] devices.enabled_mdev_types     = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ephemeral_storage_encryption.enabled = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.api_servers             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.cafile                  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.certfile                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.collect_timing          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.connect_retries         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.connect_retry_delay     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.debug                   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.default_trusted_certificate_ids = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.enable_certificate_validation = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.enable_rbd_download     = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.endpoint_override       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.insecure                = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.keyfile                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.max_version             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.min_version             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.num_retries             = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.rbd_ceph_conf           =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.rbd_connect_timeout     = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.rbd_pool                =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.rbd_user                =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.region_name             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.service_name            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.service_type            = image {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.split_loggers           = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.status_code_retries     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.status_code_retry_delay = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.timeout                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.verify_glance_signatures = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] glance.version                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] guestfs.debug                  = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.config_drive_cdrom      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.config_drive_inject_password = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.enable_instance_metrics_collection = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.enable_remotefx         = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.instances_path_share    =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.iscsi_initiator_list    = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.limit_cpu_features      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.power_state_check_timeframe = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.use_multipath_io        = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.volume_attach_retry_count = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.vswitch_name            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] mks.enabled                    = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] image_cache.manager_interval   = 2400 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] image_cache.precache_concurrency = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] image_cache.remove_unused_base_images = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] image_cache.subdirectory_name  = _base {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.api_max_retries         = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.api_retry_interval      = 2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.auth_section            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.auth_type               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.cafile                  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.certfile                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.collect_timing          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.connect_retries         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.connect_retry_delay     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.endpoint_override       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.insecure                = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.keyfile                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.max_version             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.min_version             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.partition_key           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.peer_list               = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.region_name             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.serial_console_state_timeout = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.service_name            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.service_type            = baremetal {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.split_loggers           = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.status_code_retries     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.status_code_retry_delay = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.timeout                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ironic.version                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] key_manager.fixed_key          = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.barbican_api_version  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.barbican_endpoint     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.barbican_endpoint_type = public {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.barbican_region_name  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.cafile                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.certfile              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.collect_timing        = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.insecure              = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.keyfile               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.number_of_retries     = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.retry_delay           = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.send_service_user_token = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.split_loggers         = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.timeout               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.verify_ssl            = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican.verify_ssl_path       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.auth_section = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.auth_type = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.cafile   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.certfile = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.collect_timing = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.insecure = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.keyfile  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.split_loggers = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] barbican_service_user.timeout  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.approle_role_id          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.approle_secret_id        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.cafile                   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.certfile                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.collect_timing           = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.insecure                 = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.keyfile                  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.kv_mountpoint            = secret {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.kv_version               = 2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.namespace                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.root_token_id            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.split_loggers            = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.ssl_ca_crt_file          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.timeout                  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.use_ssl                  = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.cafile                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.certfile              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.collect_timing        = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.connect_retries       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.connect_retry_delay   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.endpoint_override     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.insecure              = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.keyfile               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.max_version           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.min_version           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.region_name           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.service_name          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.service_type          = identity {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.split_loggers         = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.status_code_retries   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.status_code_retry_delay = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.timeout               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] keystone.version               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.connection_uri         =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.cpu_mode               = custom {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: WARNING oslo_config.cfg [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.cpu_power_governor_high = performance {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.cpu_power_governor_low = powersave {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.cpu_power_management   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.device_detach_attempts = 8 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.device_detach_timeout  = 20 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.disk_cachemodes        = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.disk_prefix            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.enabled_perf_events    = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.file_backed_memory     = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.gid_maps               = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.hw_disk_discard        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.hw_machine_type        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.images_rbd_glance_store_name =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.images_rbd_pool        = rbd {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.images_type            = default {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.images_volume_group    = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.inject_key             = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.inject_partition       = -2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.inject_password        = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.iscsi_iface            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.iser_use_multipath     = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_bandwidth = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_downtime = 500 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_inbound_addr = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_permit_post_copy = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_scheme  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_timeout_action = abort {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_tunnelled = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: WARNING oslo_config.cfg [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 17 15:19:24 user nova-compute[82617]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 17 15:19:24 user nova-compute[82617]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 17 15:19:24 user nova-compute[82617]: and ``live_migration_inbound_addr`` respectively.
Apr 17 15:19:24 user nova-compute[82617]: ).  Its value may be silently ignored in the future.
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.live_migration_with_native_tls = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.max_queues             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.nfs_mount_options      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.num_memory_encrypted_guests = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.num_pcie_ports         = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.pmem_namespaces        = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.quobyte_client_cfg     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rbd_secret_uuid        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rbd_user               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.remote_filesystem_transport = ssh {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rescue_image_id        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rescue_kernel_id       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rescue_ramdisk_id      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.rx_queue_size          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.smbfs_mount_options    =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.snapshot_compression   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.snapshot_image_format  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.sparse_logical_volumes = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.swtpm_enabled          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.swtpm_group            = tss {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.swtpm_user             = tss {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.sysinfo_serial         = unique {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.tx_queue_size          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.uid_maps               = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.use_virtio_for_bridges = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.virt_type              = kvm {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.volume_clear           = zero {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.volume_clear_size      = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.volume_use_multipath   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.vzstorage_cache_path   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.vzstorage_mount_user   = stack {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.auth_section           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.auth_type              = password {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.cafile                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.certfile               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.collect_timing         = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.connect_retries        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.connect_retry_delay    = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.default_floating_pool  = public {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.endpoint_override      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.extension_sync_interval = 600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.http_retries           = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.insecure               = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.keyfile                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.max_version            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.min_version            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.ovs_bridge             = br-int {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.physnets               = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.region_name            = RegionOne {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.service_metadata_proxy = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.service_name           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.service_type           = network {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.split_loggers          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.status_code_retries    = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.status_code_retry_delay = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.timeout                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] neutron.version                = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] notifications.bdms_in_notifications = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] notifications.default_level    = INFO {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] notifications.notification_format = unversioned {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] notifications.notify_on_state_change = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] pci.alias                      = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] pci.device_spec                = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] pci.report_in_placement        = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.auth_section         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.auth_type            = password {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.cafile               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.certfile             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.collect_timing       = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.connect_retries      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.connect_retry_delay  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.default_domain_id    = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.default_domain_name  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.domain_id            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.domain_name          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.endpoint_override    = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.insecure             = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.keyfile              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.max_version          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.min_version          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.password             = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.project_domain_id    = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.project_domain_name  = Default {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.project_id           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.project_name         = service {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.region_name          = RegionOne {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.service_name         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.service_type         = placement {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.split_loggers        = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.status_code_retries  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.status_code_retry_delay = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.system_scope         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.timeout              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.trust_id             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.user_domain_id       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.user_domain_name     = Default {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.user_id              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.username             = placement {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] placement.version              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.cores                    = 20 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.count_usage_from_placement = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.injected_file_content_bytes = 10240 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.injected_file_path_length = 255 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.injected_files           = 5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.instances                = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.key_pairs                = 100 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.metadata_items           = 128 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.ram                      = 51200 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.recheck_quota            = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.server_group_members     = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] quota.server_groups            = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] rdp.enabled                    = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.image_metadata_prefilter = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.max_attempts         = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.max_placement_results = 1000 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.query_placement_for_availability_zone = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.query_placement_for_image_type_support = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] scheduler.workers              = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.host_subset_size = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.isolated_hosts = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.isolated_images = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.pci_in_placement = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.track_instance_changes = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] metrics.required               = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] metrics.weight_multiplier      = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] metrics.weight_setting         = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] serial_console.enabled         = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] serial_console.port_range      = 10000:20000 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] serial_console.serialproxy_port = 6083 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.auth_section      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.auth_type         = password {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.cafile            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.certfile          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.collect_timing    = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.insecure          = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.keyfile           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.send_service_user_token = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.split_loggers     = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] service_user.timeout           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.agent_enabled            = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.enabled                  = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.html5proxy_port          = 6082 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.image_compression        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.jpeg_compression         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.playback_compression     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.server_listen            = 127.0.0.1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.streaming_mode           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] spice.zlib_compression         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] upgrade_levels.baseapi         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] upgrade_levels.cert            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] upgrade_levels.compute         = auto {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] upgrade_levels.conductor       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] upgrade_levels.scheduler       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.auth_section = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.auth_type = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.cafile = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.certfile = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.insecure = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.keyfile = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vendordata_dynamic_auth.timeout = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.api_retry_count         = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.ca_file                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.cache_prefix            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.cluster_name            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.connection_pool_size    = 10 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.console_delay_seconds   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.datastore_regex         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.host_ip                 = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.host_password           = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.host_port               = 443 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.host_username           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.insecure                = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.integration_bridge      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.maximum_objects         = 100 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.pbm_default_policy      = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.pbm_enabled             = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.pbm_wsdl_location       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.serial_port_proxy_uri   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.serial_port_service_uri = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.task_poll_interval      = 0.5 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.use_linked_clone        = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.vnc_keymap              = en-us {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.vnc_port                = 5900 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vmware.vnc_port_total          = 10000 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.auth_schemes               = ['none'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.enabled                    = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.novncproxy_port            = 6080 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.server_listen              = 0.0.0.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.vencrypt_ca_certs          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.vencrypt_client_cert       = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vnc.vencrypt_client_key        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.disable_rootwrap   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.enable_numa_live_migration = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.libvirt_disable_apic = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.client_socket_timeout     = 900 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.default_pool_size         = 1000 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.keep_alive                = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.max_header_line           = 16384 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.ssl_ca_file               = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.ssl_cert_file             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.ssl_key_file              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.tcp_keepidle              = 600 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] zvm.ca_file                    = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] zvm.cloud_connector_url        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] zvm.reachable_timeout          = 300 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.enforce_new_defaults = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.enforce_scope      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.policy_default_rule = default {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.connection_string     = messaging:// {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.enabled               = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.es_doc_type           = notification {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.es_scroll_size        = 10000 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.es_scroll_time        = 2m {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.filter_error_trace    = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.sentinel_service_name = mymaster {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.socket_timeout        = 0.1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] profiler.trace_sqlalchemy      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] remote_debug.host              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] remote_debug.port              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_notifications.retry = -1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.auth_section        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.auth_type           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.cafile              = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.certfile            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.collect_timing      = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.connect_retries     = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.connect_retry_delay = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.endpoint_id         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.endpoint_override   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.insecure            = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.keyfile             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.max_version         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.min_version         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.region_name         = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.service_name        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.service_type        = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.split_loggers       = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.status_code_retries = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.status_code_retry_delay = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.timeout             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.valid_interfaces    = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_limit.version             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_reports.file_event_handler = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] oslo_reports.log_dir           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_ovs_privileged.group  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] vif_plug_ovs_privileged.user   = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_linux_bridge.flat_interface = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_ovs.isolate_vif         = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_vif_ovs.per_port_bridge     = False {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] os_brick.lock_path             = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] privsep_osbrick.capabilities   = [21] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] privsep_osbrick.group          = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] privsep_osbrick.helper_command = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] privsep_osbrick.user           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] nova_sys_admin.group           = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] nova_sys_admin.helper_command  = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] nova_sys_admin.user            = None {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG oslo_service.service [None req-8d948443-9115-4fe6-9f8b-a884fe38a277 None None] ******************************************************************************** {{(pid=82617) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 17 15:19:24 user nova-compute[82617]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 17 15:19:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Starting native event thread {{(pid=82617) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Starting green dispatch thread {{(pid=82617) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Starting connection event dispatch thread {{(pid=82617) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Connecting to libvirt: qemu:///system {{(pid=82617) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd64a6be5f0> {{(pid=82617) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 17 15:19:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd64a6be5f0> {{(pid=82617) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 17 15:19:24 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Connection event '1' reason 'None'
Apr 17 15:19:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 17 15:19:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.mount [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Initialising _HostMountState generation 0 {{(pid=82617) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 17 15:19:32 user nova-compute[82617]: INFO nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host capabilities <capabilities>
Apr 17 15:19:32 user nova-compute[82617]:   <host>
Apr 17 15:19:32 user nova-compute[82617]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 17 15:19:32 user nova-compute[82617]:     <cpu>
Apr 17 15:19:32 user nova-compute[82617]:       <arch>x86_64</arch>
Apr 17 15:19:32 user nova-compute[82617]:       <model>IvyBridge-IBRS</model>
Apr 17 15:19:32 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:32 user nova-compute[82617]:       <microcode version='1070'/>
Apr 17 15:19:32 user nova-compute[82617]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 17 15:19:32 user nova-compute[82617]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='ss'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='vmx'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='pcid'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='osxsave'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='hypervisor'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='arat'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='tsc_adjust'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='md-clear'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='stibp'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='arch-capabilities'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='ssbd'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='invtsc'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='rsba'/>
Apr 17 15:19:32 user nova-compute[82617]:       <feature name='skip-l1dfl-vmentry'/>
Apr 17 15:19:32 user nova-compute[82617]:       <pages unit='KiB' size='4'/>
Apr 17 15:19:32 user nova-compute[82617]:       <pages unit='KiB' size='2048'/>
Apr 17 15:19:32 user nova-compute[82617]:     </cpu>
Apr 17 15:19:32 user nova-compute[82617]:     <power_management>
Apr 17 15:19:32 user nova-compute[82617]:       <suspend_mem/>
Apr 17 15:19:32 user nova-compute[82617]:       <suspend_disk/>
Apr 17 15:19:32 user nova-compute[82617]:       <suspend_hybrid/>
Apr 17 15:19:32 user nova-compute[82617]:     </power_management>
Apr 17 15:19:32 user nova-compute[82617]:     <iommu support='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     <migration_features>
Apr 17 15:19:32 user nova-compute[82617]:       <live/>
Apr 17 15:19:32 user nova-compute[82617]:       <uri_transports>
Apr 17 15:19:32 user nova-compute[82617]:         <uri_transport>tcp</uri_transport>
Apr 17 15:19:32 user nova-compute[82617]:         <uri_transport>rdma</uri_transport>
Apr 17 15:19:32 user nova-compute[82617]:       </uri_transports>
Apr 17 15:19:32 user nova-compute[82617]:     </migration_features>
Apr 17 15:19:32 user nova-compute[82617]:     <topology>
Apr 17 15:19:32 user nova-compute[82617]:       <cells num='2'>
Apr 17 15:19:32 user nova-compute[82617]:         <cell id='0'>
Apr 17 15:19:32 user nova-compute[82617]:           <memory unit='KiB'>8152920</memory>
Apr 17 15:19:32 user nova-compute[82617]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 17 15:19:32 user nova-compute[82617]:           <pages unit='KiB' size='2048'>0</pages>
Apr 17 15:19:32 user nova-compute[82617]:           <distances>
Apr 17 15:19:32 user nova-compute[82617]:             <sibling id='0' value='10'/>
Apr 17 15:19:32 user nova-compute[82617]:             <sibling id='1' value='20'/>
Apr 17 15:19:32 user nova-compute[82617]:           </distances>
Apr 17 15:19:32 user nova-compute[82617]:           <cpus num='6'>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 17 15:19:32 user nova-compute[82617]:           </cpus>
Apr 17 15:19:32 user nova-compute[82617]:         </cell>
Apr 17 15:19:32 user nova-compute[82617]:         <cell id='1'>
Apr 17 15:19:32 user nova-compute[82617]:           <memory unit='KiB'>8255068</memory>
Apr 17 15:19:32 user nova-compute[82617]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 17 15:19:32 user nova-compute[82617]:           <pages unit='KiB' size='2048'>0</pages>
Apr 17 15:19:32 user nova-compute[82617]:           <distances>
Apr 17 15:19:32 user nova-compute[82617]:             <sibling id='0' value='20'/>
Apr 17 15:19:32 user nova-compute[82617]:             <sibling id='1' value='10'/>
Apr 17 15:19:32 user nova-compute[82617]:           </distances>
Apr 17 15:19:32 user nova-compute[82617]:           <cpus num='6'>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 17 15:19:32 user nova-compute[82617]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 17 15:19:32 user nova-compute[82617]:           </cpus>
Apr 17 15:19:32 user nova-compute[82617]:         </cell>
Apr 17 15:19:32 user nova-compute[82617]:       </cells>
Apr 17 15:19:32 user nova-compute[82617]:     </topology>
Apr 17 15:19:32 user nova-compute[82617]:     <cache>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 17 15:19:32 user nova-compute[82617]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 17 15:19:32 user nova-compute[82617]:     </cache>
Apr 17 15:19:32 user nova-compute[82617]:     <secmodel>
Apr 17 15:19:32 user nova-compute[82617]:       <model>apparmor</model>
Apr 17 15:19:32 user nova-compute[82617]:       <doi>0</doi>
Apr 17 15:19:32 user nova-compute[82617]:     </secmodel>
Apr 17 15:19:32 user nova-compute[82617]:     <secmodel>
Apr 17 15:19:32 user nova-compute[82617]:       <model>dac</model>
Apr 17 15:19:32 user nova-compute[82617]:       <doi>0</doi>
Apr 17 15:19:32 user nova-compute[82617]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 17 15:19:32 user nova-compute[82617]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 17 15:19:32 user nova-compute[82617]:     </secmodel>
Apr 17 15:19:32 user nova-compute[82617]:   </host>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='alpha'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>clipper</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='armv6l'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>integratorcp</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>borzoi</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>spitz</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>nuri</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>musca-b1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>versatileab</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>kzm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>musca-a</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>smdkc210</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sx1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>z2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>tosa</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>sabrelite</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>realview-eb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>n810</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>n800</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>versatilepb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>terrier</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mainstone</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>midway</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>musicpal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>microbit</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>cubieboard</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>verdex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>netduino2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>raspi2b</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>cheetah</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>highbank</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>akita</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>connex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>collie</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>raspi0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='armv7l'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>integratorcp</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>borzoi</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>spitz</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>nuri</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>musca-b1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>versatileab</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>kzm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>musca-a</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>smdkc210</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sx1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>z2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>tosa</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>sabrelite</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>realview-eb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>n810</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>n800</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>versatilepb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>terrier</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mainstone</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>midway</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>musicpal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>microbit</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>cubieboard</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>verdex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>netduino2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>raspi2b</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>cheetah</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>highbank</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>akita</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>connex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>collie</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>raspi0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='aarch64'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>integratorcp</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>borzoi</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>spitz</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>nuri</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>musca-b1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>versatileab</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>kzm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>musca-a</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>smdkc210</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sx1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>z2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>tosa</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>sabrelite</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>realview-eb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>n810</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>n800</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>versatilepb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>terrier</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mainstone</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>midway</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>musicpal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>microbit</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>cubieboard</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>verdex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>netduino2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>raspi3b</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>raspi2b</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>cheetah</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>highbank</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>akita</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>connex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>collie</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>raspi0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <acpi default='on' toggle='yes'/>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='cris'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='i686'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>x-remote</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>isapc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>microvm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='kvm'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <pae/>
Apr 17 15:19:32 user nova-compute[82617]:       <nonpae/>
Apr 17 15:19:32 user nova-compute[82617]:       <acpi default='on' toggle='yes'/>
Apr 17 15:19:32 user nova-compute[82617]:       <apic default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='m68k'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>an5206</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>q800</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>next-cube</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='microblaze'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='microblazeel'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='mips'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='16'>malta</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mipssim</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='mipsel'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='16'>malta</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mipssim</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='mips64'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='16'>malta</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mipssim</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>pica61</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>magnum</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='mips64el'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='16'>malta</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mipssim</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>pica61</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>magnum</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='16'>boston</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='ppc'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>g3beige</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mac99</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>ppce500</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>pegasos2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sam460ex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>bamboo</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>40p</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>ref405ep</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>taihu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='ppc64'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2048'>powernv9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>taihu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2048'>powernv10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>ppce500</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>40p</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>pegasos2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>bamboo</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>g3beige</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mac99</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sam460ex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>ref405ep</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2048'>powernv8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='ppc64le'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2048'>powernv9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>taihu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2048'>powernv10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>ppce500</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>40p</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>pegasos2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>bamboo</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>g3beige</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>mac99</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sam460ex</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>ref405ep</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2048'>powernv8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='riscv32'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='8'>spike</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>opentitan</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='5'>sifive_u</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sifive_e</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='8'>virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='riscv64'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='8'>spike</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='5'>sifive_u</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>shakti_c</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sifive_e</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='8'>virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='s390x'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='sh4'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>shix</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>r2d</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='sh4eb'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>shix</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>r2d</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='sparc'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>SS-5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>SS-20</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>LX</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>SS-4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>SS-10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>Voyager</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='sparc64'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sun4u</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>niagara</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>sun4v</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='x86_64'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>64</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>x-remote</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='1'>isapc</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>microvm</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='kvm'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <acpi default='on' toggle='yes'/>
Apr 17 15:19:32 user nova-compute[82617]:       <apic default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='xtensa'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>sim</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>kc705</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>ml605</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>lx200</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>lx60</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]:   <guest>
Apr 17 15:19:32 user nova-compute[82617]:     <os_type>hvm</os_type>
Apr 17 15:19:32 user nova-compute[82617]:     <arch name='xtensaeb'>
Apr 17 15:19:32 user nova-compute[82617]:       <wordsize>32</wordsize>
Apr 17 15:19:32 user nova-compute[82617]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='4'>sim</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>kc705</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>ml605</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>virt</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>lx200</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>lx60</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 17 15:19:32 user nova-compute[82617]:       <domain type='qemu'/>
Apr 17 15:19:32 user nova-compute[82617]:     </arch>
Apr 17 15:19:32 user nova-compute[82617]:     <features>
Apr 17 15:19:32 user nova-compute[82617]:       <cpuselection/>
Apr 17 15:19:32 user nova-compute[82617]:       <deviceboot/>
Apr 17 15:19:32 user nova-compute[82617]:       <disksnapshot default='on' toggle='no'/>
Apr 17 15:19:32 user nova-compute[82617]:     </features>
Apr 17 15:19:32 user nova-compute[82617]:   </guest>
Apr 17 15:19:32 user nova-compute[82617]: </capabilities>
Apr 17 15:19:32 user nova-compute[82617]: 
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 17 15:19:33 user nova-compute[82617]: <domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:   <path>/usr/bin/qemu-system-i386</path>
Apr 17 15:19:33 user nova-compute[82617]:   <domain>kvm</domain>
Apr 17 15:19:33 user nova-compute[82617]:   <machine>pc-i440fx-jammy</machine>
Apr 17 15:19:33 user nova-compute[82617]:   <arch>i686</arch>
Apr 17 15:19:33 user nova-compute[82617]:   <vcpu max='255'/>
Apr 17 15:19:33 user nova-compute[82617]:   <iothreads supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:   <os supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='firmware'/>
Apr 17 15:19:33 user nova-compute[82617]:     <loader supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>rom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pflash</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='readonly'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='secure'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </loader>
Apr 17 15:19:33 user nova-compute[82617]:   </os>
Apr 17 15:19:33 user nova-compute[82617]:   <cpu>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-passthrough' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='hostPassthroughMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='maximum' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='maximumMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-model' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ss'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='vmx'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pcid'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='hypervisor'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arat'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='umip'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='md-clear'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibpb'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibrs'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='erms'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='lm'/>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='custom' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>qemu64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>qemu32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>phenom</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>n270</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>kvm64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>coreduo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>core2duo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>athlon</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Westmere-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Westmere</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Snowridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Penryn</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G5</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G4</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G1</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Nehalem-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Rome</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Milan</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Dhyana</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cooperlake</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Conroe</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>486</model>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:   </cpu>
Apr 17 15:19:33 user nova-compute[82617]:   <memoryBacking supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='sourceType'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>file</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>anonymous</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>memfd</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:   </memoryBacking>
Apr 17 15:19:33 user nova-compute[82617]:   <devices>
Apr 17 15:19:33 user nova-compute[82617]:     <disk supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='diskDevice'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>disk</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cdrom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>floppy</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>lun</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='bus'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ide</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>fdc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sata</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </disk>
Apr 17 15:19:33 user nova-compute[82617]:     <graphics supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sdl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vnc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>spice</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egl-headless</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </graphics>
Apr 17 15:19:33 user nova-compute[82617]:     <video supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='modelType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cirrus</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vmvga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>qxl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>none</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>bochs</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ramfb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </video>
Apr 17 15:19:33 user nova-compute[82617]:     <hostdev supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='mode'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>subsystem</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='startupPolicy'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>default</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>mandatory</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>requisite</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>optional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='subsysType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pci</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='capsType'/>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='pciBackend'/>
Apr 17 15:19:33 user nova-compute[82617]:     </hostdev>
Apr 17 15:19:33 user nova-compute[82617]:     <rng supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>random</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egd</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>builtin</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </rng>
Apr 17 15:19:33 user nova-compute[82617]:     <filesystem supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='driverType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>path</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>handle</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtiofs</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </filesystem>
Apr 17 15:19:33 user nova-compute[82617]:     <tpm supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-tis</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-crb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>passthrough</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>emulator</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </tpm>
Apr 17 15:19:33 user nova-compute[82617]:   </devices>
Apr 17 15:19:33 user nova-compute[82617]:   <features>
Apr 17 15:19:33 user nova-compute[82617]:     <gic supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:     <vmcoreinfo supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <genid supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backingStoreInput supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backup supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <sev supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:   </features>
Apr 17 15:19:33 user nova-compute[82617]: </domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 17 15:19:33 user nova-compute[82617]: <domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:   <path>/usr/bin/qemu-system-i386</path>
Apr 17 15:19:33 user nova-compute[82617]:   <domain>kvm</domain>
Apr 17 15:19:33 user nova-compute[82617]:   <machine>pc-i440fx-6.2</machine>
Apr 17 15:19:33 user nova-compute[82617]:   <arch>i686</arch>
Apr 17 15:19:33 user nova-compute[82617]:   <vcpu max='255'/>
Apr 17 15:19:33 user nova-compute[82617]:   <iothreads supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:   <os supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='firmware'/>
Apr 17 15:19:33 user nova-compute[82617]:     <loader supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>rom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pflash</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='readonly'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='secure'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </loader>
Apr 17 15:19:33 user nova-compute[82617]:   </os>
Apr 17 15:19:33 user nova-compute[82617]:   <cpu>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-passthrough' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='hostPassthroughMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='maximum' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='maximumMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-model' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ss'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='vmx'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pcid'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='hypervisor'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arat'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='umip'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='md-clear'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibpb'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibrs'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='erms'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='lm'/>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='custom' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>qemu64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>qemu32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>phenom</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>n270</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>kvm64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>coreduo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>core2duo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>athlon</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Westmere-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Westmere</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Snowridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Penryn</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G5</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G4</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G1</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Nehalem-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Rome</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Milan</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Dhyana</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cooperlake</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Conroe</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>486</model>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:   </cpu>
Apr 17 15:19:33 user nova-compute[82617]:   <memoryBacking supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='sourceType'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>file</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>anonymous</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>memfd</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:   </memoryBacking>
Apr 17 15:19:33 user nova-compute[82617]:   <devices>
Apr 17 15:19:33 user nova-compute[82617]:     <disk supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='diskDevice'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>disk</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cdrom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>floppy</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>lun</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='bus'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ide</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>fdc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sata</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </disk>
Apr 17 15:19:33 user nova-compute[82617]:     <graphics supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sdl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vnc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>spice</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egl-headless</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </graphics>
Apr 17 15:19:33 user nova-compute[82617]:     <video supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='modelType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cirrus</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vmvga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>qxl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>none</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>bochs</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ramfb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </video>
Apr 17 15:19:33 user nova-compute[82617]:     <hostdev supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='mode'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>subsystem</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='startupPolicy'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>default</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>mandatory</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>requisite</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>optional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='subsysType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pci</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='capsType'/>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='pciBackend'/>
Apr 17 15:19:33 user nova-compute[82617]:     </hostdev>
Apr 17 15:19:33 user nova-compute[82617]:     <rng supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>random</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egd</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>builtin</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </rng>
Apr 17 15:19:33 user nova-compute[82617]:     <filesystem supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='driverType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>path</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>handle</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtiofs</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </filesystem>
Apr 17 15:19:33 user nova-compute[82617]:     <tpm supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-tis</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-crb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>passthrough</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>emulator</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </tpm>
Apr 17 15:19:33 user nova-compute[82617]:   </devices>
Apr 17 15:19:33 user nova-compute[82617]:   <features>
Apr 17 15:19:33 user nova-compute[82617]:     <gic supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:     <vmcoreinfo supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <genid supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backingStoreInput supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backup supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <sev supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:   </features>
Apr 17 15:19:33 user nova-compute[82617]: </domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 17 15:19:33 user nova-compute[82617]: <domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:   <path>/usr/bin/qemu-system-i386</path>
Apr 17 15:19:33 user nova-compute[82617]:   <domain>kvm</domain>
Apr 17 15:19:33 user nova-compute[82617]:   <machine>pc-q35-6.2</machine>
Apr 17 15:19:33 user nova-compute[82617]:   <arch>i686</arch>
Apr 17 15:19:33 user nova-compute[82617]:   <vcpu max='288'/>
Apr 17 15:19:33 user nova-compute[82617]:   <iothreads supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:   <os supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='firmware'/>
Apr 17 15:19:33 user nova-compute[82617]:     <loader supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>rom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pflash</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='readonly'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='secure'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </loader>
Apr 17 15:19:33 user nova-compute[82617]:   </os>
Apr 17 15:19:33 user nova-compute[82617]:   <cpu>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-passthrough' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='hostPassthroughMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='maximum' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='maximumMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-model' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ss'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='vmx'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pcid'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='hypervisor'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arat'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='umip'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='md-clear'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibpb'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibrs'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='erms'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='lm'/>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='custom' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>qemu64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>qemu32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>phenom</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>n270</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>kvm64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>coreduo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>core2duo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>athlon</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Westmere-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Westmere</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Snowridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Penryn</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G5</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G4</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G1</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Nehalem-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Rome</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Milan</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Dhyana</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cooperlake</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Conroe</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>486</model>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:   </cpu>
Apr 17 15:19:33 user nova-compute[82617]:   <memoryBacking supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='sourceType'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>file</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>anonymous</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>memfd</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:   </memoryBacking>
Apr 17 15:19:33 user nova-compute[82617]:   <devices>
Apr 17 15:19:33 user nova-compute[82617]:     <disk supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='diskDevice'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>disk</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cdrom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>floppy</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>lun</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='bus'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>fdc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sata</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </disk>
Apr 17 15:19:33 user nova-compute[82617]:     <graphics supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sdl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vnc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>spice</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egl-headless</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </graphics>
Apr 17 15:19:33 user nova-compute[82617]:     <video supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='modelType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cirrus</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vmvga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>qxl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>none</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>bochs</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ramfb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </video>
Apr 17 15:19:33 user nova-compute[82617]:     <hostdev supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='mode'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>subsystem</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='startupPolicy'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>default</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>mandatory</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>requisite</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>optional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='subsysType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pci</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='capsType'/>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='pciBackend'/>
Apr 17 15:19:33 user nova-compute[82617]:     </hostdev>
Apr 17 15:19:33 user nova-compute[82617]:     <rng supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>random</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egd</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>builtin</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </rng>
Apr 17 15:19:33 user nova-compute[82617]:     <filesystem supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='driverType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>path</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>handle</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtiofs</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </filesystem>
Apr 17 15:19:33 user nova-compute[82617]:     <tpm supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-tis</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-crb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>passthrough</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>emulator</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </tpm>
Apr 17 15:19:33 user nova-compute[82617]:   </devices>
Apr 17 15:19:33 user nova-compute[82617]:   <features>
Apr 17 15:19:33 user nova-compute[82617]:     <gic supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:     <vmcoreinfo supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <genid supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backingStoreInput supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backup supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <sev supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:   </features>
Apr 17 15:19:33 user nova-compute[82617]: </domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 17 15:19:33 user nova-compute[82617]: <domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:   <path>/usr/bin/qemu-system-i386</path>
Apr 17 15:19:33 user nova-compute[82617]:   <domain>kvm</domain>
Apr 17 15:19:33 user nova-compute[82617]:   <machine>pc-q35-jammy</machine>
Apr 17 15:19:33 user nova-compute[82617]:   <arch>i686</arch>
Apr 17 15:19:33 user nova-compute[82617]:   <vcpu max='288'/>
Apr 17 15:19:33 user nova-compute[82617]:   <iothreads supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:   <os supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='firmware'/>
Apr 17 15:19:33 user nova-compute[82617]:     <loader supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>rom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pflash</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='readonly'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='secure'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </loader>
Apr 17 15:19:33 user nova-compute[82617]:   </os>
Apr 17 15:19:33 user nova-compute[82617]:   <cpu>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-passthrough' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='hostPassthroughMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='maximum' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='maximumMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-model' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ss'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='vmx'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pcid'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='hypervisor'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arat'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='umip'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='md-clear'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibpb'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibrs'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='erms'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='lm'/>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='custom' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>qemu64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>qemu32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>phenom</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>n270</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>kvm64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>coreduo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>core2duo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>athlon</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Westmere-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Westmere</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Snowridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Penryn</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G5</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G4</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G1</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Nehalem-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Rome</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Milan</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Dhyana</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cooperlake</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Conroe</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>486</model>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:   </cpu>
Apr 17 15:19:33 user nova-compute[82617]:   <memoryBacking supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='sourceType'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>file</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>anonymous</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>memfd</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:   </memoryBacking>
Apr 17 15:19:33 user nova-compute[82617]:   <devices>
Apr 17 15:19:33 user nova-compute[82617]:     <disk supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='diskDevice'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>disk</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cdrom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>floppy</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>lun</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='bus'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>fdc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sata</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </disk>
Apr 17 15:19:33 user nova-compute[82617]:     <graphics supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sdl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vnc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>spice</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egl-headless</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </graphics>
Apr 17 15:19:33 user nova-compute[82617]:     <video supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='modelType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cirrus</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vmvga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>qxl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>none</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>bochs</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ramfb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </video>
Apr 17 15:19:33 user nova-compute[82617]:     <hostdev supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='mode'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>subsystem</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='startupPolicy'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>default</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>mandatory</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>requisite</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>optional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='subsysType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pci</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='capsType'/>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='pciBackend'/>
Apr 17 15:19:33 user nova-compute[82617]:     </hostdev>
Apr 17 15:19:33 user nova-compute[82617]:     <rng supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>random</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egd</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>builtin</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </rng>
Apr 17 15:19:33 user nova-compute[82617]:     <filesystem supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='driverType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>path</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>handle</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtiofs</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </filesystem>
Apr 17 15:19:33 user nova-compute[82617]:     <tpm supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-tis</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-crb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>passthrough</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>emulator</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </tpm>
Apr 17 15:19:33 user nova-compute[82617]:   </devices>
Apr 17 15:19:33 user nova-compute[82617]:   <features>
Apr 17 15:19:33 user nova-compute[82617]:     <gic supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:     <vmcoreinfo supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <genid supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backingStoreInput supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backup supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <sev supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:   </features>
Apr 17 15:19:33 user nova-compute[82617]: </domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 17 15:19:33 user nova-compute[82617]: <domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 17 15:19:33 user nova-compute[82617]:   <domain>kvm</domain>
Apr 17 15:19:33 user nova-compute[82617]:   <machine>pc-i440fx-jammy</machine>
Apr 17 15:19:33 user nova-compute[82617]:   <arch>x86_64</arch>
Apr 17 15:19:33 user nova-compute[82617]:   <vcpu max='255'/>
Apr 17 15:19:33 user nova-compute[82617]:   <iothreads supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:   <os supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='firmware'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>efi</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:     <loader supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>rom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pflash</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='readonly'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='secure'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </loader>
Apr 17 15:19:33 user nova-compute[82617]:   </os>
Apr 17 15:19:33 user nova-compute[82617]:   <cpu>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-passthrough' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='hostPassthroughMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='maximum' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='maximumMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-model' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ss'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='vmx'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pcid'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='hypervisor'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arat'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='umip'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='md-clear'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='invtsc'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibpb'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibrs'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='rsba'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pschange-mc-no'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='erms'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='custom' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>qemu64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>qemu32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>phenom</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>n270</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>coreduo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>core2duo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>athlon</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Westmere-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Westmere</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Snowridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Penryn</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G5</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G4</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Opteron_G1</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Rome</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Milan</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Dhyana</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cooperlake</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Conroe</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>486</model>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:   </cpu>
Apr 17 15:19:33 user nova-compute[82617]:   <memoryBacking supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='sourceType'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>file</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>anonymous</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>memfd</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:   </memoryBacking>
Apr 17 15:19:33 user nova-compute[82617]:   <devices>
Apr 17 15:19:33 user nova-compute[82617]:     <disk supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='diskDevice'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>disk</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cdrom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>floppy</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>lun</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='bus'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ide</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>fdc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sata</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </disk>
Apr 17 15:19:33 user nova-compute[82617]:     <graphics supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sdl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vnc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>spice</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egl-headless</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </graphics>
Apr 17 15:19:33 user nova-compute[82617]:     <video supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='modelType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cirrus</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vmvga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>qxl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>none</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>bochs</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ramfb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </video>
Apr 17 15:19:33 user nova-compute[82617]:     <hostdev supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='mode'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>subsystem</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='startupPolicy'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>default</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>mandatory</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>requisite</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>optional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='subsysType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pci</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='capsType'/>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='pciBackend'/>
Apr 17 15:19:33 user nova-compute[82617]:     </hostdev>
Apr 17 15:19:33 user nova-compute[82617]:     <rng supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>random</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egd</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>builtin</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </rng>
Apr 17 15:19:33 user nova-compute[82617]:     <filesystem supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='driverType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>path</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>handle</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtiofs</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </filesystem>
Apr 17 15:19:33 user nova-compute[82617]:     <tpm supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-tis</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-crb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>passthrough</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>emulator</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </tpm>
Apr 17 15:19:33 user nova-compute[82617]:   </devices>
Apr 17 15:19:33 user nova-compute[82617]:   <features>
Apr 17 15:19:33 user nova-compute[82617]:     <gic supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:     <vmcoreinfo supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <genid supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backingStoreInput supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backup supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <sev supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:   </features>
Apr 17 15:19:33 user nova-compute[82617]: </domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 17 15:19:33 user nova-compute[82617]: <domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 17 15:19:33 user nova-compute[82617]:   <domain>kvm</domain>
Apr 17 15:19:33 user nova-compute[82617]:   <machine>pc-i440fx-6.2</machine>
Apr 17 15:19:33 user nova-compute[82617]:   <arch>x86_64</arch>
Apr 17 15:19:33 user nova-compute[82617]:   <vcpu max='255'/>
Apr 17 15:19:33 user nova-compute[82617]:   <iothreads supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:   <os supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='firmware'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>efi</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:     <loader supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>rom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pflash</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='readonly'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='secure'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </loader>
Apr 17 15:19:33 user nova-compute[82617]:   </os>
Apr 17 15:19:33 user nova-compute[82617]:   <cpu>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-passthrough' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='hostPassthroughMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='maximum' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='maximumMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-model' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ss'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='vmx'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pcid'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='hypervisor'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arat'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='umip'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='md-clear'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='invtsc'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibpb'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibrs'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='rsba'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pschange-mc-no'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='erms'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='custom' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>qemu64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>qemu32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>phenom</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>n270</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>coreduo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>core2duo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>athlon</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Westmere-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Westmere</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Snowridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Penryn</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G5</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G4</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Opteron_G1</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Rome</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Milan</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Dhyana</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cooperlake</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Conroe</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>486</model>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:   </cpu>
Apr 17 15:19:33 user nova-compute[82617]:   <memoryBacking supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='sourceType'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>file</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>anonymous</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>memfd</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:   </memoryBacking>
Apr 17 15:19:33 user nova-compute[82617]:   <devices>
Apr 17 15:19:33 user nova-compute[82617]:     <disk supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='diskDevice'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>disk</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cdrom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>floppy</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>lun</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='bus'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ide</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>fdc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sata</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </disk>
Apr 17 15:19:33 user nova-compute[82617]:     <graphics supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sdl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vnc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>spice</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egl-headless</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </graphics>
Apr 17 15:19:33 user nova-compute[82617]:     <video supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='modelType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cirrus</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vmvga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>qxl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>none</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>bochs</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ramfb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </video>
Apr 17 15:19:33 user nova-compute[82617]:     <hostdev supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='mode'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>subsystem</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='startupPolicy'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>default</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>mandatory</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>requisite</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>optional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='subsysType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pci</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='capsType'/>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='pciBackend'/>
Apr 17 15:19:33 user nova-compute[82617]:     </hostdev>
Apr 17 15:19:33 user nova-compute[82617]:     <rng supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>random</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egd</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>builtin</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </rng>
Apr 17 15:19:33 user nova-compute[82617]:     <filesystem supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='driverType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>path</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>handle</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtiofs</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </filesystem>
Apr 17 15:19:33 user nova-compute[82617]:     <tpm supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-tis</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-crb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>passthrough</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>emulator</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </tpm>
Apr 17 15:19:33 user nova-compute[82617]:   </devices>
Apr 17 15:19:33 user nova-compute[82617]:   <features>
Apr 17 15:19:33 user nova-compute[82617]:     <gic supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:     <vmcoreinfo supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <genid supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backingStoreInput supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backup supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <sev supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:   </features>
Apr 17 15:19:33 user nova-compute[82617]: </domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 17 15:19:33 user nova-compute[82617]: <domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 17 15:19:33 user nova-compute[82617]:   <domain>kvm</domain>
Apr 17 15:19:33 user nova-compute[82617]:   <machine>pc-q35-6.2</machine>
Apr 17 15:19:33 user nova-compute[82617]:   <arch>x86_64</arch>
Apr 17 15:19:33 user nova-compute[82617]:   <vcpu max='288'/>
Apr 17 15:19:33 user nova-compute[82617]:   <iothreads supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:   <os supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='firmware'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>efi</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:     <loader supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>rom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pflash</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='readonly'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='secure'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </loader>
Apr 17 15:19:33 user nova-compute[82617]:   </os>
Apr 17 15:19:33 user nova-compute[82617]:   <cpu>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-passthrough' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='hostPassthroughMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='maximum' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='maximumMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-model' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ss'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='vmx'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pcid'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='hypervisor'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arat'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='umip'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='md-clear'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='invtsc'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibpb'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibrs'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='rsba'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pschange-mc-no'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='erms'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='custom' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>qemu64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>qemu32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>phenom</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>n270</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>coreduo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>core2duo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>athlon</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Westmere-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Westmere</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Snowridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Penryn</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G5</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G4</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Opteron_G1</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Rome</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Milan</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Dhyana</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cooperlake</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Conroe</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>486</model>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:   </cpu>
Apr 17 15:19:33 user nova-compute[82617]:   <memoryBacking supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='sourceType'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>file</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>anonymous</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>memfd</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:   </memoryBacking>
Apr 17 15:19:33 user nova-compute[82617]:   <devices>
Apr 17 15:19:33 user nova-compute[82617]:     <disk supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='diskDevice'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>disk</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cdrom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>floppy</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>lun</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='bus'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>fdc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sata</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </disk>
Apr 17 15:19:33 user nova-compute[82617]:     <graphics supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sdl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vnc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>spice</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egl-headless</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </graphics>
Apr 17 15:19:33 user nova-compute[82617]:     <video supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='modelType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cirrus</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vmvga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>qxl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>none</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>bochs</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ramfb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </video>
Apr 17 15:19:33 user nova-compute[82617]:     <hostdev supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='mode'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>subsystem</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='startupPolicy'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>default</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>mandatory</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>requisite</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>optional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='subsysType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pci</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='capsType'/>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='pciBackend'/>
Apr 17 15:19:33 user nova-compute[82617]:     </hostdev>
Apr 17 15:19:33 user nova-compute[82617]:     <rng supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>random</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egd</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>builtin</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </rng>
Apr 17 15:19:33 user nova-compute[82617]:     <filesystem supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='driverType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>path</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>handle</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtiofs</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </filesystem>
Apr 17 15:19:33 user nova-compute[82617]:     <tpm supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-tis</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-crb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>passthrough</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>emulator</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </tpm>
Apr 17 15:19:33 user nova-compute[82617]:   </devices>
Apr 17 15:19:33 user nova-compute[82617]:   <features>
Apr 17 15:19:33 user nova-compute[82617]:     <gic supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:     <vmcoreinfo supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <genid supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backingStoreInput supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backup supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <sev supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:   </features>
Apr 17 15:19:33 user nova-compute[82617]: </domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 17 15:19:33 user nova-compute[82617]: <domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 17 15:19:33 user nova-compute[82617]:   <domain>kvm</domain>
Apr 17 15:19:33 user nova-compute[82617]:   <machine>pc-q35-jammy</machine>
Apr 17 15:19:33 user nova-compute[82617]:   <arch>x86_64</arch>
Apr 17 15:19:33 user nova-compute[82617]:   <vcpu max='288'/>
Apr 17 15:19:33 user nova-compute[82617]:   <iothreads supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:   <os supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='firmware'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>efi</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:     <loader supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>rom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pflash</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='readonly'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='secure'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>yes</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>no</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </loader>
Apr 17 15:19:33 user nova-compute[82617]:   </os>
Apr 17 15:19:33 user nova-compute[82617]:   <cpu>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-passthrough' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='hostPassthroughMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='maximum' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='maximumMigratable'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>on</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>off</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='host-model' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <vendor>Intel</vendor>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ss'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='vmx'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pcid'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='hypervisor'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arat'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='tsc_adjust'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='umip'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='md-clear'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='arch-capabilities'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='invtsc'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibpb'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='ibrs'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-stibp'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='amd-ssbd'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='rsba'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='require' name='pschange-mc-no'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='erms'/>
Apr 17 15:19:33 user nova-compute[82617]:       <feature policy='disable' name='xsaveopt'/>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:     <mode name='custom' supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>qemu64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>qemu32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>phenom</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>pentium</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>n270</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm64</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>kvm32</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>coreduo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>core2duo</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>athlon</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Westmere-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Westmere</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Snowridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Skylake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>SandyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Penryn</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G5</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G4</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G3</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Opteron_G2</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Opteron_G1</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>IvyBridge</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Icelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Haswell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Rome</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-Milan</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC-IBPB</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>EPYC</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Dhyana</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cooperlake</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>Conroe</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Cascadelake-Server</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-noTSX</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell-IBRS</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='no'>Broadwell</model>
Apr 17 15:19:33 user nova-compute[82617]:       <model usable='yes'>486</model>
Apr 17 15:19:33 user nova-compute[82617]:     </mode>
Apr 17 15:19:33 user nova-compute[82617]:   </cpu>
Apr 17 15:19:33 user nova-compute[82617]:   <memoryBacking supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:     <enum name='sourceType'>
Apr 17 15:19:33 user nova-compute[82617]:       <value>file</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>anonymous</value>
Apr 17 15:19:33 user nova-compute[82617]:       <value>memfd</value>
Apr 17 15:19:33 user nova-compute[82617]:     </enum>
Apr 17 15:19:33 user nova-compute[82617]:   </memoryBacking>
Apr 17 15:19:33 user nova-compute[82617]:   <devices>
Apr 17 15:19:33 user nova-compute[82617]:     <disk supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='diskDevice'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>disk</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cdrom</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>floppy</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>lun</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='bus'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>fdc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sata</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </disk>
Apr 17 15:19:33 user nova-compute[82617]:     <graphics supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='type'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>sdl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vnc</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>spice</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egl-headless</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </graphics>
Apr 17 15:19:33 user nova-compute[82617]:     <video supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='modelType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>cirrus</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>vmvga</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>qxl</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>none</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>bochs</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>ramfb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </video>
Apr 17 15:19:33 user nova-compute[82617]:     <hostdev supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='mode'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>subsystem</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='startupPolicy'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>default</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>mandatory</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>requisite</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>optional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='subsysType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>usb</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>pci</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>scsi</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='capsType'/>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='pciBackend'/>
Apr 17 15:19:33 user nova-compute[82617]:     </hostdev>
Apr 17 15:19:33 user nova-compute[82617]:     <rng supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtio-non-transitional</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>random</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>egd</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>builtin</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </rng>
Apr 17 15:19:33 user nova-compute[82617]:     <filesystem supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='driverType'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>path</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>handle</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>virtiofs</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </filesystem>
Apr 17 15:19:33 user nova-compute[82617]:     <tpm supported='yes'>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='model'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-tis</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>tpm-crb</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:       <enum name='backendModel'>
Apr 17 15:19:33 user nova-compute[82617]:         <value>passthrough</value>
Apr 17 15:19:33 user nova-compute[82617]:         <value>emulator</value>
Apr 17 15:19:33 user nova-compute[82617]:       </enum>
Apr 17 15:19:33 user nova-compute[82617]:     </tpm>
Apr 17 15:19:33 user nova-compute[82617]:   </devices>
Apr 17 15:19:33 user nova-compute[82617]:   <features>
Apr 17 15:19:33 user nova-compute[82617]:     <gic supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:     <vmcoreinfo supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <genid supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backingStoreInput supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <backup supported='yes'/>
Apr 17 15:19:33 user nova-compute[82617]:     <sev supported='no'/>
Apr 17 15:19:33 user nova-compute[82617]:   </features>
Apr 17 15:19:33 user nova-compute[82617]: </domainCapabilities>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=82617) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=82617) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Checking secure boot support for host arch (x86_64) {{(pid=82617) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Checking secure boot support for host arch (x86_64) {{(pid=82617) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Checking secure boot support for host arch (x86_64) {{(pid=82617) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Checking secure boot support for host arch (x86_64) {{(pid=82617) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Checking secure boot support for host arch (x86_64) {{(pid=82617) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 17 15:19:33 user nova-compute[82617]: INFO nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Secure Boot support detected
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] cpu compare xml: <cpu match="exact">
Apr 17 15:19:33 user nova-compute[82617]:   <model>Nehalem</model>
Apr 17 15:19:33 user nova-compute[82617]: </cpu>
Apr 17 15:19:33 user nova-compute[82617]:  {{(pid=82617) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 17 15:19:33 user nova-compute[82617]: INFO nova.virt.node [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Generated node identity 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93
Apr 17 15:19:33 user nova-compute[82617]: INFO nova.virt.node [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Wrote node identity 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 to /opt/stack/data/nova/compute_id
Apr 17 15:19:33 user nova-compute[82617]: WARNING nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Compute nodes ['9bb2eafe-db18-48a2-a75a-4c24d9b0dd93'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 17 15:19:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 17 15:19:33 user nova-compute[82617]: WARNING nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 17 15:19:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:19:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:19:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Hypervisor/Node resource view: name=user free_ram=10804MB free_disk=27.104541778564453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:19:33 user nova-compute[82617]: WARNING nova.compute.resource_tracker [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] No compute node record for user:9bb2eafe-db18-48a2-a75a-4c24d9b0dd93: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 could not be found.
Apr 17 15:19:33 user nova-compute[82617]: INFO nova.compute.resource_tracker [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Compute node record created for user:user with uuid: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:19:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:19:34 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [req-739fb58f-6042-40c2-8ef9-e6be4ade8305] Created resource provider record via placement API for resource provider with UUID 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 and name user.
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=82617) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 17 15:19:34 user nova-compute[82617]: INFO nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] kernel doesn't support AMD SEV
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Libvirt baseline CPU <cpu>
Apr 17 15:19:34 user nova-compute[82617]:   <arch>x86_64</arch>
Apr 17 15:19:34 user nova-compute[82617]:   <model>Nehalem</model>
Apr 17 15:19:34 user nova-compute[82617]:   <vendor>Intel</vendor>
Apr 17 15:19:34 user nova-compute[82617]:   <topology sockets="6" cores="1" threads="1"/>
Apr 17 15:19:34 user nova-compute[82617]: </cpu>
Apr 17 15:19:34 user nova-compute[82617]:  {{(pid=82617) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Updated inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Updating resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 generation from 0 to 1 during operation: update_inventory {{(pid=82617) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Updating resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 generation from 1 to 2 during operation: update_traits {{(pid=82617) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.service [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Creating RPC server for service compute {{(pid=82617) start /opt/stack/nova/nova/service.py:182}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.service [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Join ServiceGroup membership for this service compute {{(pid=82617) start /opt/stack/nova/nova/service.py:199}}
Apr 17 15:19:34 user nova-compute[82617]: DEBUG nova.servicegroup.drivers.db [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=82617) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 17 15:19:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:19:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:20:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:20:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=10220MB free_disk=27.01856231689453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:20:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:21:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:21:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:21:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:21:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:21:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:21:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=10157MB free_disk=27.01077651977539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:21:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:21:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:22:26 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:22:26 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:22:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=10126MB free_disk=26.844619750976562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:22:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:22:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:22:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:22:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 15:22:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:22:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:23:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:23:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=9467MB free_disk=26.873008728027344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:23:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:23:43 user nova-compute[82617]: INFO nova.compute.claims [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Claim successful on node user
Apr 17 15:23:43 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:23:43 user nova-compute[82617]: DEBUG nova.network.neutron [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:23:43 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:23:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:23:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:23:44 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:23:44 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Creating image(s)
Apr 17 15:23:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "/opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "/opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "/opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832.part --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG nova.policy [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fec7c09a38ee413db724c659acc576ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aecd98c92d74f6b9879e6f57125ebde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832.part --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG nova.virt.images [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] b3f0dec1-7758-44a8-82e0-76ada8837428 was qcow2, converting to raw {{(pid=82617) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832.part /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832.converted {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832.part /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832.converted" returned: 0 in 0.211s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832.converted --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.294s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:45 user nova-compute[82617]: INFO oslo.privsep.daemon [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpk3w8oj68/privsep.sock']
Apr 17 15:23:45 user sudo[91335]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpk3w8oj68/privsep.sock
Apr 17 15:23:45 user sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 17 15:23:47 user nova-compute[82617]: DEBUG nova.network.neutron [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Successfully created port: d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:23:47 user sudo[91335]: pam_unix(sudo:session): session closed for user root
Apr 17 15:23:47 user nova-compute[82617]: INFO oslo.privsep.daemon [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Spawned new privsep daemon via rootwrap
Apr 17 15:23:47 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 17 15:23:47 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 17 15:23:47 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 17 15:23:47 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91340
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk 1073741824" returned: 0 in 0.053s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Cannot resize image /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG nova.objects.instance [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lazy-loading 'migration_context' on Instance uuid 70667df1-34e8-4063-a2fc-1fc7d63318f9 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Ensure instance console log exists: /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Successfully updated port: d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:23:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:23:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquired lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:23:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:23:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:23:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c8443dd5-9743-4365-bbcd-e9472f7ea1b6 req-0b6a9f27-6d88-409f-9482-873455c74164 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received event network-changed-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:23:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c8443dd5-9743-4365-bbcd-e9472f7ea1b6 req-0b6a9f27-6d88-409f-9482-873455c74164 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Refreshing instance network info cache due to event network-changed-d5d2e201-0f95-420c-ab2a-cc475e36d2f5. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:23:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c8443dd5-9743-4365-bbcd-e9472f7ea1b6 req-0b6a9f27-6d88-409f-9482-873455c74164 service nova] Acquiring lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.network.neutron [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Updating instance_info_cache with network_info: [{"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Releasing lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Instance network_info: |[{"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c8443dd5-9743-4365-bbcd-e9472f7ea1b6 req-0b6a9f27-6d88-409f-9482-873455c74164 service nova] Acquired lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.network.neutron [req-c8443dd5-9743-4365-bbcd-e9472f7ea1b6 req-0b6a9f27-6d88-409f-9482-873455c74164 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Refreshing network info cache for port d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Start _get_guest_xml network_info=[{"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:23:51 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:23:51 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2114257856',display_name='tempest-DeleteServersTestJSON-server-2114257856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2114257856',id=1,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aecd98c92d74f6b9879e6f57125ebde',ramdisk_id='',reservation_id='r-0s4imm0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1458225442',owner_user_name='tempest-DeleteServersTestJSON-1458225442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:23:44Z,user_data=None,user_id='fec7c09a38ee413db724c659acc576ce',uuid=70667df1-34e8-4063-a2fc-1fc7d63318f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Converting VIF {"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:1d,bridge_name='br-int',has_traffic_filtering=True,id=d5d2e201-0f95-420c-ab2a-cc475e36d2f5,network=Network(97617f5f-1a5f-4847-bac4-3e6b4fc93222),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d2e201-0f') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.objects.instance [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lazy-loading 'pci_devices' on Instance uuid 70667df1-34e8-4063-a2fc-1fc7d63318f9 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:23:51 user nova-compute[82617]:   <uuid>70667df1-34e8-4063-a2fc-1fc7d63318f9</uuid>
Apr 17 15:23:51 user nova-compute[82617]:   <name>instance-00000001</name>
Apr 17 15:23:51 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:23:51 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:23:51 user nova-compute[82617]:   <metadata>
Apr 17 15:23:51 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:23:51 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:23:51 user nova-compute[82617]:       <nova:name>tempest-DeleteServersTestJSON-server-2114257856</nova:name>
Apr 17 15:23:51 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:23:51</nova:creationTime>
Apr 17 15:23:51 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:23:51 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:23:51 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:23:51 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:23:51 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:23:51 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:23:51 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:23:51 user nova-compute[82617]:       <nova:owner>
Apr 17 15:23:51 user nova-compute[82617]:         <nova:user uuid="fec7c09a38ee413db724c659acc576ce">tempest-DeleteServersTestJSON-1458225442-project-member</nova:user>
Apr 17 15:23:51 user nova-compute[82617]:         <nova:project uuid="8aecd98c92d74f6b9879e6f57125ebde">tempest-DeleteServersTestJSON-1458225442</nova:project>
Apr 17 15:23:51 user nova-compute[82617]:       </nova:owner>
Apr 17 15:23:51 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:23:51 user nova-compute[82617]:       <nova:ports>
Apr 17 15:23:51 user nova-compute[82617]:         <nova:port uuid="d5d2e201-0f95-420c-ab2a-cc475e36d2f5">
Apr 17 15:23:51 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 17 15:23:51 user nova-compute[82617]:         </nova:port>
Apr 17 15:23:51 user nova-compute[82617]:       </nova:ports>
Apr 17 15:23:51 user nova-compute[82617]:     </nova:instance>
Apr 17 15:23:51 user nova-compute[82617]:   </metadata>
Apr 17 15:23:51 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:23:51 user nova-compute[82617]:     <system>
Apr 17 15:23:51 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:23:51 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:23:51 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:23:51 user nova-compute[82617]:       <entry name="serial">70667df1-34e8-4063-a2fc-1fc7d63318f9</entry>
Apr 17 15:23:51 user nova-compute[82617]:       <entry name="uuid">70667df1-34e8-4063-a2fc-1fc7d63318f9</entry>
Apr 17 15:23:51 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:23:51 user nova-compute[82617]:     </system>
Apr 17 15:23:51 user nova-compute[82617]:   </sysinfo>
Apr 17 15:23:51 user nova-compute[82617]:   <os>
Apr 17 15:23:51 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:23:51 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:23:51 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:23:51 user nova-compute[82617]:   </os>
Apr 17 15:23:51 user nova-compute[82617]:   <features>
Apr 17 15:23:51 user nova-compute[82617]:     <acpi/>
Apr 17 15:23:51 user nova-compute[82617]:     <apic/>
Apr 17 15:23:51 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:23:51 user nova-compute[82617]:   </features>
Apr 17 15:23:51 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:23:51 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:23:51 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:23:51 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:23:51 user nova-compute[82617]:   </clock>
Apr 17 15:23:51 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:23:51 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:23:51 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:23:51 user nova-compute[82617]:   </cpu>
Apr 17 15:23:51 user nova-compute[82617]:   <devices>
Apr 17 15:23:51 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:23:51 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:23:51 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk"/>
Apr 17 15:23:51 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:23:51 user nova-compute[82617]:     </disk>
Apr 17 15:23:51 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:23:51 user nova-compute[82617]:       <mac address="fa:16:3e:ea:1e:1d"/>
Apr 17 15:23:51 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:23:51 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:23:51 user nova-compute[82617]:       <target dev="tapd5d2e201-0f"/>
Apr 17 15:23:51 user nova-compute[82617]:     </interface>
Apr 17 15:23:51 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:23:51 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/console.log" append="off"/>
Apr 17 15:23:51 user nova-compute[82617]:     </serial>
Apr 17 15:23:51 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:23:51 user nova-compute[82617]:     <video>
Apr 17 15:23:51 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:23:51 user nova-compute[82617]:     </video>
Apr 17 15:23:51 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:23:51 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:23:51 user nova-compute[82617]:     </rng>
Apr 17 15:23:51 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:23:51 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:23:51 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:23:51 user nova-compute[82617]:     </memballoon>
Apr 17 15:23:51 user nova-compute[82617]:   </devices>
Apr 17 15:23:51 user nova-compute[82617]: </domain>
Apr 17 15:23:51 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2114257856',display_name='tempest-DeleteServersTestJSON-server-2114257856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2114257856',id=1,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aecd98c92d74f6b9879e6f57125ebde',ramdisk_id='',reservation_id='r-0s4imm0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1458225442',owner_user_name='tempest-DeleteServersTestJSON-1458225442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:23:44Z,user_data=None,user_id='fec7c09a38ee413db724c659acc576ce',uuid=70667df1-34e8-4063-a2fc-1fc7d63318f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Converting VIF {"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:1d,bridge_name='br-int',has_traffic_filtering=True,id=d5d2e201-0f95-420c-ab2a-cc475e36d2f5,network=Network(97617f5f-1a5f-4847-bac4-3e6b4fc93222),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d2e201-0f') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG os_vif [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:1d,bridge_name='br-int',has_traffic_filtering=True,id=d5d2e201-0f95-420c-ab2a-cc475e36d2f5,network=Network(97617f5f-1a5f-4847-bac4-3e6b4fc93222),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d2e201-0f') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Created schema index Interface.name {{(pid=82617) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Created schema index Port.name {{(pid=82617) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Created schema index Bridge.name {{(pid=82617) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [POLLOUT] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:23:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:23:51 user nova-compute[82617]: INFO oslo.privsep.daemon [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpiddjn1ag/privsep.sock']
Apr 17 15:23:51 user sudo[91360]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpiddjn1ag/privsep.sock
Apr 17 15:23:51 user sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 17 15:23:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-c8443dd5-9743-4365-bbcd-e9472f7ea1b6 req-0b6a9f27-6d88-409f-9482-873455c74164 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Updated VIF entry in instance network info cache for port d5d2e201-0f95-420c-ab2a-cc475e36d2f5. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:23:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-c8443dd5-9743-4365-bbcd-e9472f7ea1b6 req-0b6a9f27-6d88-409f-9482-873455c74164 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Updating instance_info_cache with network_info: [{"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:23:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c8443dd5-9743-4365-bbcd-e9472f7ea1b6 req-0b6a9f27-6d88-409f-9482-873455c74164 service nova] Releasing lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:23:53 user sudo[91360]: pam_unix(sudo:session): session closed for user root
Apr 17 15:23:53 user nova-compute[82617]: INFO oslo.privsep.daemon [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Spawned new privsep daemon via rootwrap
Apr 17 15:23:53 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 17 15:23:53 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 17 15:23:53 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 17 15:23:53 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91365
Apr 17 15:23:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5d2e201-0f, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:23:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5d2e201-0f, col_values=(('external_ids', {'iface-id': 'd5d2e201-0f95-420c-ab2a-cc475e36d2f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:1e:1d', 'vm-uuid': '70667df1-34e8-4063-a2fc-1fc7d63318f9'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:23:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:23:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:54 user nova-compute[82617]: INFO os_vif [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:1d,bridge_name='br-int',has_traffic_filtering=True,id=d5d2e201-0f95-420c-ab2a-cc475e36d2f5,network=Network(97617f5f-1a5f-4847-bac4-3e6b4fc93222),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d2e201-0f')
Apr 17 15:23:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:23:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] No VIF found with MAC fa:16:3e:ea:1e:1d, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:23:55 user nova-compute[82617]: INFO nova.compute.claims [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Claim successful on node user
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:23:56 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:23:56 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Creating image(s)
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-8d2b0fd4-75ad-4594-8e12-90143cb38bc9 req-316a7396-7ab1-45de-9d8f-1e604cec3e24 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received event network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8d2b0fd4-75ad-4594-8e12-90143cb38bc9 req-316a7396-7ab1-45de-9d8f-1e604cec3e24 service nova] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8d2b0fd4-75ad-4594-8e12-90143cb38bc9 req-316a7396-7ab1-45de-9d8f-1e604cec3e24 service nova] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8d2b0fd4-75ad-4594-8e12-90143cb38bc9 req-316a7396-7ab1-45de-9d8f-1e604cec3e24 service nova] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-8d2b0fd4-75ad-4594-8e12-90143cb38bc9 req-316a7396-7ab1-45de-9d8f-1e604cec3e24 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] No waiting events found dispatching network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:23:56 user nova-compute[82617]: WARNING nova.compute.manager [req-8d2b0fd4-75ad-4594-8e12-90143cb38bc9 req-316a7396-7ab1-45de-9d8f-1e604cec3e24 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received unexpected event network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 for instance with vm_state building and task_state spawning.
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG nova.policy [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '638a4f535e9740fc9d810639a5eb24d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5f6b5ed2fc43b69c47e1fc18646545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk 1073741824" returned: 0 in 0.049s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.170s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Cannot resize image /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.objects.instance [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'migration_context' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Ensure instance console log exists: /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745037.481637, 70667df1-34e8-4063-a2fc-1fc7d63318f9 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:23:57 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] VM Resumed (Lifecycle Event)
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:23:57 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Instance spawned successfully.
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:23:57 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745037.4894872, 70667df1-34e8-4063-a2fc-1fc7d63318f9 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:23:57 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] VM Started (Lifecycle Event)
Apr 17 15:23:57 user nova-compute[82617]: INFO nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Took 13.51 seconds to spawn the instance on the hypervisor.
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:23:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:23:57 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:23:57 user nova-compute[82617]: INFO nova.compute.manager [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Took 14.44 seconds to build instance.
Apr 17 15:23:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ae43d5a-d111-4b15-b880-2a6f82afd402 tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.801s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:23:58 user nova-compute[82617]: INFO nova.compute.claims [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Claim successful on node user
Apr 17 15:23:58 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:23:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-93fa92c4-0eb9-4219-a34e-dee34e8964a6 req-e56f0d39-cccd-4554-bc03-ad5fb3000bf1 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received event network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-93fa92c4-0eb9-4219-a34e-dee34e8964a6 req-e56f0d39-cccd-4554-bc03-ad5fb3000bf1 service nova] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-93fa92c4-0eb9-4219-a34e-dee34e8964a6 req-e56f0d39-cccd-4554-bc03-ad5fb3000bf1 service nova] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-93fa92c4-0eb9-4219-a34e-dee34e8964a6 req-e56f0d39-cccd-4554-bc03-ad5fb3000bf1 service nova] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-93fa92c4-0eb9-4219-a34e-dee34e8964a6 req-e56f0d39-cccd-4554-bc03-ad5fb3000bf1 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] No waiting events found dispatching network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:23:59 user nova-compute[82617]: WARNING nova.compute.manager [req-93fa92c4-0eb9-4219-a34e-dee34e8964a6 req-e56f0d39-cccd-4554-bc03-ad5fb3000bf1 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received unexpected event network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 for instance with vm_state active and task_state None.
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:23:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Creating image(s)
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Successfully created port: 3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.193s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.policy [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a972c04314724233bc8e33b64747fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdfb8642b9341f6ba289e920c33cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.196s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk 1073741824" returned: 0 in 0.067s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.163s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:23:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Cannot resize image /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG nova.objects.instance [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'migration_context' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Ensure instance console log exists: /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Successfully created port: 06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:24:01 user nova-compute[82617]: INFO nova.compute.claims [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Claim successful on node user
Apr 17 15:24:01 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:01 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:24:02 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:24:02 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:24:02 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Creating image(s)
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.213s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.179s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG nova.policy [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83b9d77de46143d8b9277a55f5ad4d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214a0f233f114d7aa22e64048a837c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk 1073741824" returned: 0 in 0.070s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.167s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:24:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Cannot resize image /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.objects.instance [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'migration_context' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Ensure instance console log exists: /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Successfully updated port: 3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-691450e9-b48b-40ab-a2e2-88c6bb6d9c16 req-025ee809-f46c-4283-a011-cc02d1bf583d service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-changed-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-691450e9-b48b-40ab-a2e2-88c6bb6d9c16 req-025ee809-f46c-4283-a011-cc02d1bf583d service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Refreshing instance network info cache due to event network-changed-3318391f-7474-432a-ab24-5eec02673b8b. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-691450e9-b48b-40ab-a2e2-88c6bb6d9c16 req-025ee809-f46c-4283-a011-cc02d1bf583d service nova] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:24:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Successfully updated port: 06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG nova.compute.manager [req-593a07ca-2b3c-4b12-bd33-1d4ddb7233ca req-65d79fe8-13bb-4241-8c43-da19bd0b840a service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG nova.compute.manager [req-593a07ca-2b3c-4b12-bd33-1d4ddb7233ca req-65d79fe8-13bb-4241-8c43-da19bd0b840a service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing instance network info cache due to event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:24:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-593a07ca-2b3c-4b12-bd33-1d4ddb7233ca req-65d79fe8-13bb-4241-8c43-da19bd0b840a service nova] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance network_info: |[{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-691450e9-b48b-40ab-a2e2-88c6bb6d9c16 req-025ee809-f46c-4283-a011-cc02d1bf583d service nova] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.network.neutron [req-691450e9-b48b-40ab-a2e2-88c6bb6d9c16 req-025ee809-f46c-4283-a011-cc02d1bf583d service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Refreshing network info cache for port 3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Start _get_guest_xml network_info=[{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:24:05 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:05 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1046525286',display_name='tempest-ServerActionsTestJSON-server-1046525286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1046525286',id=2,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF/iT/MoNqI4mhGgg4bOPeUaFmt+HKbeuQKnHdTMDQH/HNrNLZzsK9yPUW4qjOgGc4Pp1VwczdJXHNBz2a1NYZg13VzE5dIV1MKrnPYhhBkxvkUIIsFdmTFbdFLrQg4nw==',key_name='tempest-keypair-200176256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb5f6b5ed2fc43b69c47e1fc18646545',ramdisk_id='',reservation_id='r-d8m8mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-645547919',owner_user_name='tempest-ServerActionsTestJSON-645547919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:23:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='638a4f535e9740fc9d810639a5eb24d7',uuid=d109f8c3-aed3-45af-ba8d-30b9006ef4e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converting VIF {"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.objects.instance [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'pci_devices' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:24:05 user nova-compute[82617]:   <uuid>d109f8c3-aed3-45af-ba8d-30b9006ef4e4</uuid>
Apr 17 15:24:05 user nova-compute[82617]:   <name>instance-00000002</name>
Apr 17 15:24:05 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:24:05 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:24:05 user nova-compute[82617]:   <metadata>
Apr 17 15:24:05 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:24:05 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:24:05 user nova-compute[82617]:       <nova:name>tempest-ServerActionsTestJSON-server-1046525286</nova:name>
Apr 17 15:24:05 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:24:05</nova:creationTime>
Apr 17 15:24:05 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:24:05 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:24:05 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:24:05 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:24:05 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:24:05 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:24:05 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:24:05 user nova-compute[82617]:       <nova:owner>
Apr 17 15:24:05 user nova-compute[82617]:         <nova:user uuid="638a4f535e9740fc9d810639a5eb24d7">tempest-ServerActionsTestJSON-645547919-project-member</nova:user>
Apr 17 15:24:05 user nova-compute[82617]:         <nova:project uuid="cb5f6b5ed2fc43b69c47e1fc18646545">tempest-ServerActionsTestJSON-645547919</nova:project>
Apr 17 15:24:05 user nova-compute[82617]:       </nova:owner>
Apr 17 15:24:05 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:24:05 user nova-compute[82617]:       <nova:ports>
Apr 17 15:24:05 user nova-compute[82617]:         <nova:port uuid="3318391f-7474-432a-ab24-5eec02673b8b">
Apr 17 15:24:05 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 17 15:24:05 user nova-compute[82617]:         </nova:port>
Apr 17 15:24:05 user nova-compute[82617]:       </nova:ports>
Apr 17 15:24:05 user nova-compute[82617]:     </nova:instance>
Apr 17 15:24:05 user nova-compute[82617]:   </metadata>
Apr 17 15:24:05 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:24:05 user nova-compute[82617]:     <system>
Apr 17 15:24:05 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:24:05 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:24:05 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:24:05 user nova-compute[82617]:       <entry name="serial">d109f8c3-aed3-45af-ba8d-30b9006ef4e4</entry>
Apr 17 15:24:05 user nova-compute[82617]:       <entry name="uuid">d109f8c3-aed3-45af-ba8d-30b9006ef4e4</entry>
Apr 17 15:24:05 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:24:05 user nova-compute[82617]:     </system>
Apr 17 15:24:05 user nova-compute[82617]:   </sysinfo>
Apr 17 15:24:05 user nova-compute[82617]:   <os>
Apr 17 15:24:05 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:24:05 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:24:05 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:24:05 user nova-compute[82617]:   </os>
Apr 17 15:24:05 user nova-compute[82617]:   <features>
Apr 17 15:24:05 user nova-compute[82617]:     <acpi/>
Apr 17 15:24:05 user nova-compute[82617]:     <apic/>
Apr 17 15:24:05 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:24:05 user nova-compute[82617]:   </features>
Apr 17 15:24:05 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:24:05 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:24:05 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:24:05 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:24:05 user nova-compute[82617]:   </clock>
Apr 17 15:24:05 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:24:05 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:24:05 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:24:05 user nova-compute[82617]:   </cpu>
Apr 17 15:24:05 user nova-compute[82617]:   <devices>
Apr 17 15:24:05 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:24:05 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:24:05 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk"/>
Apr 17 15:24:05 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:24:05 user nova-compute[82617]:     </disk>
Apr 17 15:24:05 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:24:05 user nova-compute[82617]:       <mac address="fa:16:3e:26:9b:4e"/>
Apr 17 15:24:05 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:05 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:24:05 user nova-compute[82617]:       <target dev="tap3318391f-74"/>
Apr 17 15:24:05 user nova-compute[82617]:     </interface>
Apr 17 15:24:05 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:24:05 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/console.log" append="off"/>
Apr 17 15:24:05 user nova-compute[82617]:     </serial>
Apr 17 15:24:05 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:24:05 user nova-compute[82617]:     <video>
Apr 17 15:24:05 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:05 user nova-compute[82617]:     </video>
Apr 17 15:24:05 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:24:05 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:24:05 user nova-compute[82617]:     </rng>
Apr 17 15:24:05 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:24:05 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:24:05 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:24:05 user nova-compute[82617]:     </memballoon>
Apr 17 15:24:05 user nova-compute[82617]:   </devices>
Apr 17 15:24:05 user nova-compute[82617]: </domain>
Apr 17 15:24:05 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1046525286',display_name='tempest-ServerActionsTestJSON-server-1046525286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1046525286',id=2,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF/iT/MoNqI4mhGgg4bOPeUaFmt+HKbeuQKnHdTMDQH/HNrNLZzsK9yPUW4qjOgGc4Pp1VwczdJXHNBz2a1NYZg13VzE5dIV1MKrnPYhhBkxvkUIIsFdmTFbdFLrQg4nw==',key_name='tempest-keypair-200176256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb5f6b5ed2fc43b69c47e1fc18646545',ramdisk_id='',reservation_id='r-d8m8mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-645547919',owner_user_name='tempest-ServerActionsTestJSON-645547919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:23:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='638a4f535e9740fc9d810639a5eb24d7',uuid=d109f8c3-aed3-45af-ba8d-30b9006ef4e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converting VIF {"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG os_vif [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3318391f-74, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3318391f-74, col_values=(('external_ids', {'iface-id': '3318391f-7474-432a-ab24-5eec02673b8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:9b:4e', 'vm-uuid': 'd109f8c3-aed3-45af-ba8d-30b9006ef4e4'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:05 user nova-compute[82617]: INFO os_vif [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74')
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] No VIF found with MAC fa:16:3e:26:9b:4e, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Successfully created port: 3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance network_info: |[{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-593a07ca-2b3c-4b12-bd33-1d4ddb7233ca req-65d79fe8-13bb-4241-8c43-da19bd0b840a service nova] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-593a07ca-2b3c-4b12-bd33-1d4ddb7233ca req-65d79fe8-13bb-4241-8c43-da19bd0b840a service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Start _get_guest_xml network_info=[{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-765067727',display_name='tempest-ServerStableDeviceRescueTest-server-765067727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-765067727',id=3,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR2JdSi+da6BnbUL1hFO3Ku02OwrmKfJuXj9P3Ezj/X2hlOgPsocvEmY0qLTq4AOoVu5vKe2On73/43+BWss3ne+tcJcBX/XQHcOOL4ILUdxQAMJED5bkmazbJQaFRpzQ==',key_name='tempest-keypair-1194004845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bdfb8642b9341f6ba289e920c33cf47',ramdisk_id='',reservation_id='r-dawq23oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-869290889',owner_user_name='tempest-ServerStableDeviceRescueTest-869290889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:23:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a972c04314724233bc8e33b64747fecf',uuid=fc3385ee-a569-4a45-812b-b9073d774535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Converting VIF {"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:22:83,bridge_name='br-int',has_traffic_filtering=True,id=06c113c7-a663-47b8-a618-0a22d3e345a4,network=Network(7925f982-32fb-4fc9-b421-8dffeb064b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c113c7-a6') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.objects.instance [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'pci_devices' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:24:06 user nova-compute[82617]:   <uuid>fc3385ee-a569-4a45-812b-b9073d774535</uuid>
Apr 17 15:24:06 user nova-compute[82617]:   <name>instance-00000003</name>
Apr 17 15:24:06 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:24:06 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:24:06 user nova-compute[82617]:   <metadata>
Apr 17 15:24:06 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:24:06 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:24:06 user nova-compute[82617]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-765067727</nova:name>
Apr 17 15:24:06 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:24:06</nova:creationTime>
Apr 17 15:24:06 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:24:06 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:24:06 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:24:06 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:24:06 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:24:06 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:24:06 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:24:06 user nova-compute[82617]:       <nova:owner>
Apr 17 15:24:06 user nova-compute[82617]:         <nova:user uuid="a972c04314724233bc8e33b64747fecf">tempest-ServerStableDeviceRescueTest-869290889-project-member</nova:user>
Apr 17 15:24:06 user nova-compute[82617]:         <nova:project uuid="6bdfb8642b9341f6ba289e920c33cf47">tempest-ServerStableDeviceRescueTest-869290889</nova:project>
Apr 17 15:24:06 user nova-compute[82617]:       </nova:owner>
Apr 17 15:24:06 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:24:06 user nova-compute[82617]:       <nova:ports>
Apr 17 15:24:06 user nova-compute[82617]:         <nova:port uuid="06c113c7-a663-47b8-a618-0a22d3e345a4">
Apr 17 15:24:06 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 15:24:06 user nova-compute[82617]:         </nova:port>
Apr 17 15:24:06 user nova-compute[82617]:       </nova:ports>
Apr 17 15:24:06 user nova-compute[82617]:     </nova:instance>
Apr 17 15:24:06 user nova-compute[82617]:   </metadata>
Apr 17 15:24:06 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:24:06 user nova-compute[82617]:     <system>
Apr 17 15:24:06 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:24:06 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:24:06 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:24:06 user nova-compute[82617]:       <entry name="serial">fc3385ee-a569-4a45-812b-b9073d774535</entry>
Apr 17 15:24:06 user nova-compute[82617]:       <entry name="uuid">fc3385ee-a569-4a45-812b-b9073d774535</entry>
Apr 17 15:24:06 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:24:06 user nova-compute[82617]:     </system>
Apr 17 15:24:06 user nova-compute[82617]:   </sysinfo>
Apr 17 15:24:06 user nova-compute[82617]:   <os>
Apr 17 15:24:06 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:24:06 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:24:06 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:24:06 user nova-compute[82617]:   </os>
Apr 17 15:24:06 user nova-compute[82617]:   <features>
Apr 17 15:24:06 user nova-compute[82617]:     <acpi/>
Apr 17 15:24:06 user nova-compute[82617]:     <apic/>
Apr 17 15:24:06 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:24:06 user nova-compute[82617]:   </features>
Apr 17 15:24:06 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:24:06 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:24:06 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:24:06 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:24:06 user nova-compute[82617]:   </clock>
Apr 17 15:24:06 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:24:06 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:24:06 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:24:06 user nova-compute[82617]:   </cpu>
Apr 17 15:24:06 user nova-compute[82617]:   <devices>
Apr 17 15:24:06 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:24:06 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:24:06 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk"/>
Apr 17 15:24:06 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:24:06 user nova-compute[82617]:     </disk>
Apr 17 15:24:06 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:24:06 user nova-compute[82617]:       <mac address="fa:16:3e:b8:22:83"/>
Apr 17 15:24:06 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:06 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:24:06 user nova-compute[82617]:       <target dev="tap06c113c7-a6"/>
Apr 17 15:24:06 user nova-compute[82617]:     </interface>
Apr 17 15:24:06 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:24:06 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/console.log" append="off"/>
Apr 17 15:24:06 user nova-compute[82617]:     </serial>
Apr 17 15:24:06 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:24:06 user nova-compute[82617]:     <video>
Apr 17 15:24:06 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:06 user nova-compute[82617]:     </video>
Apr 17 15:24:06 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:24:06 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:24:06 user nova-compute[82617]:     </rng>
Apr 17 15:24:06 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:24:06 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:24:06 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:24:06 user nova-compute[82617]:     </memballoon>
Apr 17 15:24:06 user nova-compute[82617]:   </devices>
Apr 17 15:24:06 user nova-compute[82617]: </domain>
Apr 17 15:24:06 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-765067727',display_name='tempest-ServerStableDeviceRescueTest-server-765067727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-765067727',id=3,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR2JdSi+da6BnbUL1hFO3Ku02OwrmKfJuXj9P3Ezj/X2hlOgPsocvEmY0qLTq4AOoVu5vKe2On73/43+BWss3ne+tcJcBX/XQHcOOL4ILUdxQAMJED5bkmazbJQaFRpzQ==',key_name='tempest-keypair-1194004845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bdfb8642b9341f6ba289e920c33cf47',ramdisk_id='',reservation_id='r-dawq23oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-869290889',owner_user_name='tempest-ServerStableDeviceRescueTest-869290889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:23:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a972c04314724233bc8e33b64747fecf',uuid=fc3385ee-a569-4a45-812b-b9073d774535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Converting VIF {"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:22:83,bridge_name='br-int',has_traffic_filtering=True,id=06c113c7-a663-47b8-a618-0a22d3e345a4,network=Network(7925f982-32fb-4fc9-b421-8dffeb064b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c113c7-a6') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG os_vif [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:22:83,bridge_name='br-int',has_traffic_filtering=True,id=06c113c7-a663-47b8-a618-0a22d3e345a4,network=Network(7925f982-32fb-4fc9-b421-8dffeb064b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c113c7-a6') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06c113c7-a6, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06c113c7-a6, col_values=(('external_ids', {'iface-id': '06c113c7-a663-47b8-a618-0a22d3e345a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:22:83', 'vm-uuid': 'fc3385ee-a569-4a45-812b-b9073d774535'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:06 user nova-compute[82617]: INFO os_vif [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:22:83,bridge_name='br-int',has_traffic_filtering=True,id=06c113c7-a663-47b8-a618-0a22d3e345a4,network=Network(7925f982-32fb-4fc9-b421-8dffeb064b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c113c7-a6')
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No VIF found with MAC fa:16:3e:b8:22:83, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-691450e9-b48b-40ab-a2e2-88c6bb6d9c16 req-025ee809-f46c-4283-a011-cc02d1bf583d service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated VIF entry in instance network info cache for port 3318391f-7474-432a-ab24-5eec02673b8b. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-691450e9-b48b-40ab-a2e2-88c6bb6d9c16 req-025ee809-f46c-4283-a011-cc02d1bf583d service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-691450e9-b48b-40ab-a2e2-88c6bb6d9c16 req-025ee809-f46c-4283-a011-cc02d1bf583d service nova] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Successfully updated port: 3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-b1eb9ea5-16f8-4c89-b9f0-4b71e9625f8c req-95a55053-d2e8-4ed0-9635-ef78907ef316 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-changed-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-b1eb9ea5-16f8-4c89-b9f0-4b71e9625f8c req-95a55053-d2e8-4ed0-9635-ef78907ef316 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Refreshing instance network info cache due to event network-changed-3ae715f2-409f-4855-94cc-3bbb6cbf1b41. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b1eb9ea5-16f8-4c89-b9f0-4b71e9625f8c req-95a55053-d2e8-4ed0-9635-ef78907ef316 service nova] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-593a07ca-2b3c-4b12-bd33-1d4ddb7233ca req-65d79fe8-13bb-4241-8c43-da19bd0b840a service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated VIF entry in instance network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-593a07ca-2b3c-4b12-bd33-1d4ddb7233ca req-65d79fe8-13bb-4241-8c43-da19bd0b840a service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-593a07ca-2b3c-4b12-bd33-1d4ddb7233ca req-65d79fe8-13bb-4241-8c43-da19bd0b840a service nova] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance network_info: |[{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b1eb9ea5-16f8-4c89-b9f0-4b71e9625f8c req-95a55053-d2e8-4ed0-9635-ef78907ef316 service nova] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.network.neutron [req-b1eb9ea5-16f8-4c89-b9f0-4b71e9625f8c req-95a55053-d2e8-4ed0-9635-ef78907ef316 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Refreshing network info cache for port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Start _get_guest_xml network_info=[{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:24:09 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:09 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-474197410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-474197410',id=4,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaV5vFW5tSygMV/NjPz/shhbcvvyXgIAkaTiBn6tH7J/Mye3Ceh6X2NAQjgM8DqKIlKuMD3s9S4hv0vkh4ho64Mh7ytYIRT4djMpVqyPPj6yRhbanlyE17Pj7gUlgQXBA==',key_name='tempest-keypair-1690039047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-qleldwb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=6aab9803-ab51-47c6-a2a2-739a7a18f5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.objects.instance [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:24:09 user nova-compute[82617]:   <uuid>6aab9803-ab51-47c6-a2a2-739a7a18f5dc</uuid>
Apr 17 15:24:09 user nova-compute[82617]:   <name>instance-00000004</name>
Apr 17 15:24:09 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:24:09 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:24:09 user nova-compute[82617]:   <metadata>
Apr 17 15:24:09 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:24:09 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:24:09 user nova-compute[82617]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-474197410</nova:name>
Apr 17 15:24:09 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:24:09</nova:creationTime>
Apr 17 15:24:09 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:24:09 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:24:09 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:24:09 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:24:09 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:24:09 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:24:09 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:24:09 user nova-compute[82617]:       <nova:owner>
Apr 17 15:24:09 user nova-compute[82617]:         <nova:user uuid="83b9d77de46143d8b9277a55f5ad4d72">tempest-AttachVolumeShelveTestJSON-1745617049-project-member</nova:user>
Apr 17 15:24:09 user nova-compute[82617]:         <nova:project uuid="214a0f233f114d7aa22e64048a837c0b">tempest-AttachVolumeShelveTestJSON-1745617049</nova:project>
Apr 17 15:24:09 user nova-compute[82617]:       </nova:owner>
Apr 17 15:24:09 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:24:09 user nova-compute[82617]:       <nova:ports>
Apr 17 15:24:09 user nova-compute[82617]:         <nova:port uuid="3ae715f2-409f-4855-94cc-3bbb6cbf1b41">
Apr 17 15:24:09 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 15:24:09 user nova-compute[82617]:         </nova:port>
Apr 17 15:24:09 user nova-compute[82617]:       </nova:ports>
Apr 17 15:24:09 user nova-compute[82617]:     </nova:instance>
Apr 17 15:24:09 user nova-compute[82617]:   </metadata>
Apr 17 15:24:09 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:24:09 user nova-compute[82617]:     <system>
Apr 17 15:24:09 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:24:09 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:24:09 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:24:09 user nova-compute[82617]:       <entry name="serial">6aab9803-ab51-47c6-a2a2-739a7a18f5dc</entry>
Apr 17 15:24:09 user nova-compute[82617]:       <entry name="uuid">6aab9803-ab51-47c6-a2a2-739a7a18f5dc</entry>
Apr 17 15:24:09 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:24:09 user nova-compute[82617]:     </system>
Apr 17 15:24:09 user nova-compute[82617]:   </sysinfo>
Apr 17 15:24:09 user nova-compute[82617]:   <os>
Apr 17 15:24:09 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:24:09 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:24:09 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:24:09 user nova-compute[82617]:   </os>
Apr 17 15:24:09 user nova-compute[82617]:   <features>
Apr 17 15:24:09 user nova-compute[82617]:     <acpi/>
Apr 17 15:24:09 user nova-compute[82617]:     <apic/>
Apr 17 15:24:09 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:24:09 user nova-compute[82617]:   </features>
Apr 17 15:24:09 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:24:09 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:24:09 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:24:09 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:24:09 user nova-compute[82617]:   </clock>
Apr 17 15:24:09 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:24:09 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:24:09 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:24:09 user nova-compute[82617]:   </cpu>
Apr 17 15:24:09 user nova-compute[82617]:   <devices>
Apr 17 15:24:09 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:24:09 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:24:09 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk"/>
Apr 17 15:24:09 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:24:09 user nova-compute[82617]:     </disk>
Apr 17 15:24:09 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:24:09 user nova-compute[82617]:       <mac address="fa:16:3e:9a:66:02"/>
Apr 17 15:24:09 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:09 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:24:09 user nova-compute[82617]:       <target dev="tap3ae715f2-40"/>
Apr 17 15:24:09 user nova-compute[82617]:     </interface>
Apr 17 15:24:09 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:24:09 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/console.log" append="off"/>
Apr 17 15:24:09 user nova-compute[82617]:     </serial>
Apr 17 15:24:09 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:24:09 user nova-compute[82617]:     <video>
Apr 17 15:24:09 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:09 user nova-compute[82617]:     </video>
Apr 17 15:24:09 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:24:09 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:24:09 user nova-compute[82617]:     </rng>
Apr 17 15:24:09 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:24:09 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:24:09 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:24:09 user nova-compute[82617]:     </memballoon>
Apr 17 15:24:09 user nova-compute[82617]:   </devices>
Apr 17 15:24:09 user nova-compute[82617]: </domain>
Apr 17 15:24:09 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-474197410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-474197410',id=4,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaV5vFW5tSygMV/NjPz/shhbcvvyXgIAkaTiBn6tH7J/Mye3Ceh6X2NAQjgM8DqKIlKuMD3s9S4hv0vkh4ho64Mh7ytYIRT4djMpVqyPPj6yRhbanlyE17Pj7gUlgQXBA==',key_name='tempest-keypair-1690039047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-qleldwb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=6aab9803-ab51-47c6-a2a2-739a7a18f5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG os_vif [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ae715f2-40, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ae715f2-40, col_values=(('external_ids', {'iface-id': '3ae715f2-409f-4855-94cc-3bbb6cbf1b41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:66:02', 'vm-uuid': '6aab9803-ab51-47c6-a2a2-739a7a18f5dc'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:24:09 user nova-compute[82617]: INFO os_vif [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40')
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] No VIF found with MAC fa:16:3e:9a:66:02, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:24:09 user nova-compute[82617]: DEBUG nova.compute.manager [req-342ef6e6-5471-48e6-943e-a13c12d514f4 req-55d9c8d8-b9c3-48b3-aff0-da72fa0ef9f8 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-342ef6e6-5471-48e6-943e-a13c12d514f4 req-55d9c8d8-b9c3-48b3-aff0-da72fa0ef9f8 service nova] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-342ef6e6-5471-48e6-943e-a13c12d514f4 req-55d9c8d8-b9c3-48b3-aff0-da72fa0ef9f8 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-342ef6e6-5471-48e6-943e-a13c12d514f4 req-55d9c8d8-b9c3-48b3-aff0-da72fa0ef9f8 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.012s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-342ef6e6-5471-48e6-943e-a13c12d514f4 req-55d9c8d8-b9c3-48b3-aff0-da72fa0ef9f8 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] No waiting events found dispatching network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:10 user nova-compute[82617]: WARNING nova.compute.manager [req-342ef6e6-5471-48e6-943e-a13c12d514f4 req-55d9c8d8-b9c3-48b3-aff0-da72fa0ef9f8 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received unexpected event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b for instance with vm_state building and task_state spawning.
Apr 17 15:24:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG nova.network.neutron [req-b1eb9ea5-16f8-4c89-b9f0-4b71e9625f8c req-95a55053-d2e8-4ed0-9635-ef78907ef316 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updated VIF entry in instance network info cache for port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG nova.network.neutron [req-b1eb9ea5-16f8-4c89-b9f0-4b71e9625f8c req-95a55053-d2e8-4ed0-9635-ef78907ef316 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b1eb9ea5-16f8-4c89-b9f0-4b71e9625f8c req-95a55053-d2e8-4ed0-9635-ef78907ef316 service nova] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745051.3329704, d109f8c3-aed3-45af-ba8d-30b9006ef4e4 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] VM Resumed (Lifecycle Event)
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance spawned successfully.
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745051.333135, d109f8c3-aed3-45af-ba8d-30b9006ef4e4 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] VM Started (Lifecycle Event)
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Took 15.13 seconds to spawn the instance on the hypervisor.
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745051.7533946, fc3385ee-a569-4a45-812b-b9073d774535 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] VM Resumed (Lifecycle Event)
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance spawned successfully.
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Took 16.00 seconds to build instance.
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef649464-d2a5-4323-8121-cb73c01c9a0b tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.171s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745051.7668908, fc3385ee-a569-4a45-812b-b9073d774535 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] VM Started (Lifecycle Event)
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:12 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:12 user nova-compute[82617]: INFO nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Took 12.81 seconds to spawn the instance on the hypervisor.
Apr 17 15:24:12 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] No waiting events found dispatching network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:12 user nova-compute[82617]: WARNING nova.compute.manager [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received unexpected event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b for instance with vm_state active and task_state None.
Apr 17 15:24:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:12 user nova-compute[82617]: WARNING nova.compute.manager [req-315baded-63dc-43d3-ac1c-4ce1463bc13e req-8e4bd983-a4f3-4f36-8ed9-d24a369edb4e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state building and task_state spawning.
Apr 17 15:24:12 user nova-compute[82617]: INFO nova.compute.manager [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Took 13.70 seconds to build instance.
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2448fd3e-ad72-46d3-82d3-791bf3b1d562 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.865s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-5644d50a-5bd3-4f24-be60-8ec7cd886aa0 req-610c8302-a8f9-4490-81a8-c8fdf11e6ef6 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5644d50a-5bd3-4f24-be60-8ec7cd886aa0 req-610c8302-a8f9-4490-81a8-c8fdf11e6ef6 service nova] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5644d50a-5bd3-4f24-be60-8ec7cd886aa0 req-610c8302-a8f9-4490-81a8-c8fdf11e6ef6 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5644d50a-5bd3-4f24-be60-8ec7cd886aa0 req-610c8302-a8f9-4490-81a8-c8fdf11e6ef6 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-5644d50a-5bd3-4f24-be60-8ec7cd886aa0 req-610c8302-a8f9-4490-81a8-c8fdf11e6ef6 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] No waiting events found dispatching network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:12 user nova-compute[82617]: WARNING nova.compute.manager [req-5644d50a-5bd3-4f24-be60-8ec7cd886aa0 req-610c8302-a8f9-4490-81a8-c8fdf11e6ef6 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received unexpected event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 for instance with vm_state building and task_state spawning.
Apr 17 15:24:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-44fd92c7-9f58-49a0-bc90-06b9033b67da req-605cd4b0-c1cd-46ac-8ce4-0ba453d79703 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-44fd92c7-9f58-49a0-bc90-06b9033b67da req-605cd4b0-c1cd-46ac-8ce4-0ba453d79703 service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-44fd92c7-9f58-49a0-bc90-06b9033b67da req-605cd4b0-c1cd-46ac-8ce4-0ba453d79703 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-44fd92c7-9f58-49a0-bc90-06b9033b67da req-605cd4b0-c1cd-46ac-8ce4-0ba453d79703 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-44fd92c7-9f58-49a0-bc90-06b9033b67da req-605cd4b0-c1cd-46ac-8ce4-0ba453d79703 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:14 user nova-compute[82617]: WARNING nova.compute.manager [req-44fd92c7-9f58-49a0-bc90-06b9033b67da req-605cd4b0-c1cd-46ac-8ce4-0ba453d79703 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state active and task_state None.
Apr 17 15:24:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-6cf290f3-7c0d-4ef3-9284-10ea818818f0 req-8c8ceaae-de8c-4f4a-b154-678107d7fc1e service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6cf290f3-7c0d-4ef3-9284-10ea818818f0 req-8c8ceaae-de8c-4f4a-b154-678107d7fc1e service nova] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6cf290f3-7c0d-4ef3-9284-10ea818818f0 req-8c8ceaae-de8c-4f4a-b154-678107d7fc1e service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6cf290f3-7c0d-4ef3-9284-10ea818818f0 req-8c8ceaae-de8c-4f4a-b154-678107d7fc1e service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-6cf290f3-7c0d-4ef3-9284-10ea818818f0 req-8c8ceaae-de8c-4f4a-b154-678107d7fc1e service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] No waiting events found dispatching network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:14 user nova-compute[82617]: WARNING nova.compute.manager [req-6cf290f3-7c0d-4ef3-9284-10ea818818f0 req-8c8ceaae-de8c-4f4a-b154-678107d7fc1e service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received unexpected event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 for instance with vm_state building and task_state spawning.
Apr 17 15:24:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745054.9595468, 6aab9803-ab51-47c6-a2a2-739a7a18f5dc => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] VM Resumed (Lifecycle Event)
Apr 17 15:24:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:24:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:24:14 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance spawned successfully.
Apr 17 15:24:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:15 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745054.9606695, 6aab9803-ab51-47c6-a2a2-739a7a18f5dc => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:15 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] VM Started (Lifecycle Event)
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:15 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:15 user nova-compute[82617]: INFO nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Took 12.95 seconds to spawn the instance on the hypervisor.
Apr 17 15:24:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:15 user nova-compute[82617]: INFO nova.compute.manager [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Took 14.02 seconds to build instance.
Apr 17 15:24:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2ec68b4f-545f-449a-bcec-bf6b41114d23 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.209s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:24:17 user nova-compute[82617]: INFO nova.compute.claims [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Claim successful on node user
Apr 17 15:24:17 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:24:17 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:24:18 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:24:18 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:24:18 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Creating image(s)
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "/opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "/opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "/opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG nova.policy [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dfadfd30c394b46abe75ec930007850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b334c5bc33f143c484518d9bd0e750dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.247s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.171s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk 1073741824" returned: 0 in 0.084s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.157s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:18 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Cannot resize image /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG nova.objects.instance [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'migration_context' on Instance uuid df469608-5f17-4f70-8933-fe92adcd3837 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Ensure instance console log exists: /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:21 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Successfully created port: 5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:24:22 user nova-compute[82617]: INFO nova.compute.claims [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Claim successful on node user
Apr 17 15:24:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:24:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Successfully updated port: 5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquired lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.801s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.643s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-60b2ec6c-03ac-47b7-8b78-a4370b0e07a1 req-1ba1a86d-3662-437d-a5cf-07fc9c74a8c6 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received event network-changed-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-60b2ec6c-03ac-47b7-8b78-a4370b0e07a1 req-1ba1a86d-3662-437d-a5cf-07fc9c74a8c6 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Refreshing instance network info cache due to event network-changed-5ff3398f-eb1e-477e-9678-d331ee7f278d. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-60b2ec6c-03ac-47b7-8b78-a4370b0e07a1 req-1ba1a86d-3662-437d-a5cf-07fc9c74a8c6 service nova] Acquiring lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:24:23 user nova-compute[82617]: INFO nova.compute.claims [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Claim successful on node user
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:24:23 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.policy [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1734894909e44118bd60e233dc501a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd4ceec29874bc38e8da456cab2048d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:24:23 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Creating image(s)
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "/opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "/opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "/opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "5d6c931bbcf08b23c92b79cdff5102f1d136633d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "5d6c931bbcf08b23c92b79cdff5102f1d136633d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d.part --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:23 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d.part --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.images [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] 911f0f9a-e08e-404e-927e-0239328839b0 was qcow2, converting to raw {{(pid=82617) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d.part /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d.converted {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updating instance_info_cache with network_info: [{"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Releasing lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Instance network_info: |[{"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-60b2ec6c-03ac-47b7-8b78-a4370b0e07a1 req-1ba1a86d-3662-437d-a5cf-07fc9c74a8c6 service nova] Acquired lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.network.neutron [req-60b2ec6c-03ac-47b7-8b78-a4370b0e07a1 req-1ba1a86d-3662-437d-a5cf-07fc9c74a8c6 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Refreshing network info cache for port 5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Start _get_guest_xml network_info=[{"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.950s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.131s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:24:24 user nova-compute[82617]: INFO nova.compute.claims [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Claim successful on node user
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d.part /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d.converted" returned: 0 in 0.202s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d.converted --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Successfully created port: 159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.network.neutron [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:24:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-858667918',display_name='tempest-VolumesAdminNegativeTest-server-858667918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-858667918',id=5,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1Hsqi4glC0WnZUxbiqM+S05blTE/Rza3njT70e8v0X40Wh/Q58QfGz7PEUqNtnXSOLvs6KHX/N52iy6W4+ahSFVrr8wn6IDPOAH2vAAvNq7O5MyAbb1mZiXcBOGsHKJg==',key_name='tempest-keypair-225894771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b334c5bc33f143c484518d9bd0e750dd',ramdisk_id='',reservation_id='r-p8d0ze59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1285212149',owner_user_name='tempest-VolumesAdminNegativeTest-1285212149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dfadfd30c394b46abe75ec930007850',uuid=df469608-5f17-4f70-8933-fe92adcd3837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converting VIF {"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:76:e7,bridge_name='br-int',has_traffic_filtering=True,id=5ff3398f-eb1e-477e-9678-d331ee7f278d,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff3398f-eb') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.objects.instance [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'pci_devices' on Instance uuid df469608-5f17-4f70-8933-fe92adcd3837 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:24 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "5d6c931bbcf08b23c92b79cdff5102f1d136633d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.838s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:24:24 user nova-compute[82617]:   <uuid>df469608-5f17-4f70-8933-fe92adcd3837</uuid>
Apr 17 15:24:24 user nova-compute[82617]:   <name>instance-00000005</name>
Apr 17 15:24:24 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:24:24 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:24:24 user nova-compute[82617]:   <metadata>
Apr 17 15:24:24 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:24:24 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:24:24 user nova-compute[82617]:       <nova:name>tempest-VolumesAdminNegativeTest-server-858667918</nova:name>
Apr 17 15:24:24 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:24:24</nova:creationTime>
Apr 17 15:24:24 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:24:24 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:24:24 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:24:24 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:24:24 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:24:24 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:24:24 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:24:24 user nova-compute[82617]:       <nova:owner>
Apr 17 15:24:24 user nova-compute[82617]:         <nova:user uuid="3dfadfd30c394b46abe75ec930007850">tempest-VolumesAdminNegativeTest-1285212149-project-member</nova:user>
Apr 17 15:24:24 user nova-compute[82617]:         <nova:project uuid="b334c5bc33f143c484518d9bd0e750dd">tempest-VolumesAdminNegativeTest-1285212149</nova:project>
Apr 17 15:24:24 user nova-compute[82617]:       </nova:owner>
Apr 17 15:24:24 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:24:24 user nova-compute[82617]:       <nova:ports>
Apr 17 15:24:24 user nova-compute[82617]:         <nova:port uuid="5ff3398f-eb1e-477e-9678-d331ee7f278d">
Apr 17 15:24:24 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 15:24:24 user nova-compute[82617]:         </nova:port>
Apr 17 15:24:24 user nova-compute[82617]:       </nova:ports>
Apr 17 15:24:24 user nova-compute[82617]:     </nova:instance>
Apr 17 15:24:24 user nova-compute[82617]:   </metadata>
Apr 17 15:24:24 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:24:24 user nova-compute[82617]:     <system>
Apr 17 15:24:24 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:24:24 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:24:24 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:24:24 user nova-compute[82617]:       <entry name="serial">df469608-5f17-4f70-8933-fe92adcd3837</entry>
Apr 17 15:24:24 user nova-compute[82617]:       <entry name="uuid">df469608-5f17-4f70-8933-fe92adcd3837</entry>
Apr 17 15:24:24 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:24:24 user nova-compute[82617]:     </system>
Apr 17 15:24:24 user nova-compute[82617]:   </sysinfo>
Apr 17 15:24:24 user nova-compute[82617]:   <os>
Apr 17 15:24:24 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:24:24 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:24:24 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:24:24 user nova-compute[82617]:   </os>
Apr 17 15:24:24 user nova-compute[82617]:   <features>
Apr 17 15:24:24 user nova-compute[82617]:     <acpi/>
Apr 17 15:24:24 user nova-compute[82617]:     <apic/>
Apr 17 15:24:24 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:24:24 user nova-compute[82617]:   </features>
Apr 17 15:24:24 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:24:24 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:24:24 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:24:24 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:24:24 user nova-compute[82617]:   </clock>
Apr 17 15:24:24 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:24:24 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:24:24 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:24:24 user nova-compute[82617]:   </cpu>
Apr 17 15:24:24 user nova-compute[82617]:   <devices>
Apr 17 15:24:24 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:24:24 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:24:24 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk"/>
Apr 17 15:24:24 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:24:24 user nova-compute[82617]:     </disk>
Apr 17 15:24:24 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:24:24 user nova-compute[82617]:       <mac address="fa:16:3e:61:76:e7"/>
Apr 17 15:24:24 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:24 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:24:24 user nova-compute[82617]:       <target dev="tap5ff3398f-eb"/>
Apr 17 15:24:24 user nova-compute[82617]:     </interface>
Apr 17 15:24:24 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:24:24 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/console.log" append="off"/>
Apr 17 15:24:24 user nova-compute[82617]:     </serial>
Apr 17 15:24:24 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:24:24 user nova-compute[82617]:     <video>
Apr 17 15:24:24 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:24 user nova-compute[82617]:     </video>
Apr 17 15:24:24 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:24:24 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:24:24 user nova-compute[82617]:     </rng>
Apr 17 15:24:24 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:24:24 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:24:24 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:24:24 user nova-compute[82617]:     </memballoon>
Apr 17 15:24:24 user nova-compute[82617]:   </devices>
Apr 17 15:24:24 user nova-compute[82617]: </domain>
Apr 17 15:24:24 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-858667918',display_name='tempest-VolumesAdminNegativeTest-server-858667918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-858667918',id=5,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1Hsqi4glC0WnZUxbiqM+S05blTE/Rza3njT70e8v0X40Wh/Q58QfGz7PEUqNtnXSOLvs6KHX/N52iy6W4+ahSFVrr8wn6IDPOAH2vAAvNq7O5MyAbb1mZiXcBOGsHKJg==',key_name='tempest-keypair-225894771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b334c5bc33f143c484518d9bd0e750dd',ramdisk_id='',reservation_id='r-p8d0ze59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1285212149',owner_user_name='tempest-VolumesAdminNegativeTest-1285212149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dfadfd30c394b46abe75ec930007850',uuid=df469608-5f17-4f70-8933-fe92adcd3837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converting VIF {"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:76:e7,bridge_name='br-int',has_traffic_filtering=True,id=5ff3398f-eb1e-477e-9678-d331ee7f278d,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff3398f-eb') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG os_vif [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:76:e7,bridge_name='br-int',has_traffic_filtering=True,id=5ff3398f-eb1e-477e-9678-d331ee7f278d,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff3398f-eb') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ff3398f-eb, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ff3398f-eb, col_values=(('external_ids', {'iface-id': '5ff3398f-eb1e-477e-9678-d331ee7f278d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:76:e7', 'vm-uuid': 'df469608-5f17-4f70-8933-fe92adcd3837'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:24 user nova-compute[82617]: INFO os_vif [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:76:e7,bridge_name='br-int',has_traffic_filtering=True,id=5ff3398f-eb1e-477e-9678-d331ee7f278d,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff3398f-eb')
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.policy [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c2bfcb4119e483ab1a41e3c598ee1b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00b574796d1942938ed2f348803fcf87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d --force-share --output=json" returned: 0 in 0.210s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "5d6c931bbcf08b23c92b79cdff5102f1d136633d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "5d6c931bbcf08b23c92b79cdff5102f1d136633d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:24:24 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Creating image(s)
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "/opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "/opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "/opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] No VIF found with MAC fa:16:3e:61:76:e7, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d --force-share --output=json" returned: 0 in 0.189s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d,backing_fmt=raw /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d,backing_fmt=raw /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk 1073741824" returned: 0 in 0.062s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "5d6c931bbcf08b23c92b79cdff5102f1d136633d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.231s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.154s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d --force-share --output=json" returned: 0 in 0.292s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk 1073741824" returned: 0 in 0.110s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Cannot resize image /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.objects.instance [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lazy-loading 'migration_context' on Instance uuid 3456d072-ae41-4bd2-bd5d-3622a9a5a23d {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Ensure instance console log exists: /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Successfully updated port: 159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquired lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.250s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-2afdafd7-742e-4e11-a735-f1f0521837fe req-21dd7358-1a1c-439d-9a0d-f5177c5df9f9 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received event network-changed-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-2afdafd7-742e-4e11-a735-f1f0521837fe req-21dd7358-1a1c-439d-9a0d-f5177c5df9f9 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Refreshing instance network info cache due to event network-changed-159f4c8b-7692-4b13-8c6a-884b6ccd8964. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2afdafd7-742e-4e11-a735-f1f0521837fe req-21dd7358-1a1c-439d-9a0d-f5177c5df9f9 service nova] Acquiring lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.network.neutron [req-60b2ec6c-03ac-47b7-8b78-a4370b0e07a1 req-1ba1a86d-3662-437d-a5cf-07fc9c74a8c6 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updated VIF entry in instance network info cache for port 5ff3398f-eb1e-477e-9678-d331ee7f278d. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.network.neutron [req-60b2ec6c-03ac-47b7-8b78-a4370b0e07a1 req-1ba1a86d-3662-437d-a5cf-07fc9c74a8c6 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updating instance_info_cache with network_info: [{"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-60b2ec6c-03ac-47b7-8b78-a4370b0e07a1 req-1ba1a86d-3662-437d-a5cf-07fc9c74a8c6 service nova] Releasing lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Cannot resize image /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.objects.instance [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lazy-loading 'migration_context' on Instance uuid 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Ensure instance console log exists: /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.805s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:24:26 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.network.neutron [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Successfully created port: 991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Updating instance_info_cache with network_info: [{"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Releasing lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Instance network_info: |[{"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2afdafd7-742e-4e11-a735-f1f0521837fe req-21dd7358-1a1c-439d-9a0d-f5177c5df9f9 service nova] Acquired lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.network.neutron [req-2afdafd7-742e-4e11-a735-f1f0521837fe req-21dd7358-1a1c-439d-9a0d-f5177c5df9f9 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Refreshing network info cache for port 159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Start _get_guest_xml network_info=[{"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:24:12Z,direct_url=<?>,disk_format='qcow2',id=911f0f9a-e08e-404e-927e-0239328839b0,min_disk=0,min_ram=0,name='',owner='cee91c684bea4c44aeac95835d726f38',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:24:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/sda', 'size': 0, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '911f0f9a-e08e-404e-927e-0239328839b0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:24:26 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:26 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:24:12Z,direct_url=<?>,disk_format='qcow2',id=911f0f9a-e08e-404e-927e-0239328839b0,min_disk=0,min_ram=0,name='',owner='cee91c684bea4c44aeac95835d726f38',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:24:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-353147092',display_name='tempest-AttachSCSIVolumeTestJSON-server-353147092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-353147092',id=6,image_ref='911f0f9a-e08e-404e-927e-0239328839b0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMik5YI1BskjrMfwqNYIJSXfH/EglGjrkBEzbJNkzpmFhPDGgkvsbY09Hv08wuU5IlCSf6+ruYbkEIhdfaqNbjxS5QSP3lcxK8A+eOfyf9q3S6JRSK1NK9BfOQHeJN04w==',key_name='tempest-keypair-212722224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fd4ceec29874bc38e8da456cab2048d',ramdisk_id='',reservation_id='r-mq0ucv0z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='911f0f9a-e08e-404e-927e-0239328839b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-944917744',owner_user_name='tempest-AttachSCSIVolumeTestJSON-944917744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1734894909e44118bd60e233dc501a0',uuid=3456d072-ae41-4bd2-bd5d-3622a9a5a23d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Converting VIF {"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:73:ba,bridge_name='br-int',has_traffic_filtering=True,id=159f4c8b-7692-4b13-8c6a-884b6ccd8964,network=Network(bd093d71-00e5-48a6-b9fa-db1d299a5525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f4c8b-76') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.objects.instance [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lazy-loading 'pci_devices' on Instance uuid 3456d072-ae41-4bd2-bd5d-3622a9a5a23d {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.policy [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f081ecb75ec14053b68d74cacf61c802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa73323c3c4c689f4012505d8b4833', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:24:26 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Creating image(s)
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:24:26 user nova-compute[82617]:   <uuid>3456d072-ae41-4bd2-bd5d-3622a9a5a23d</uuid>
Apr 17 15:24:26 user nova-compute[82617]:   <name>instance-00000006</name>
Apr 17 15:24:26 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:24:26 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:24:26 user nova-compute[82617]:   <metadata>
Apr 17 15:24:26 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:24:26 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:24:26 user nova-compute[82617]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-353147092</nova:name>
Apr 17 15:24:26 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:24:26</nova:creationTime>
Apr 17 15:24:26 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:24:26 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:24:26 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:24:26 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:24:26 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:24:26 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:24:26 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:24:26 user nova-compute[82617]:       <nova:owner>
Apr 17 15:24:26 user nova-compute[82617]:         <nova:user uuid="b1734894909e44118bd60e233dc501a0">tempest-AttachSCSIVolumeTestJSON-944917744-project-member</nova:user>
Apr 17 15:24:26 user nova-compute[82617]:         <nova:project uuid="0fd4ceec29874bc38e8da456cab2048d">tempest-AttachSCSIVolumeTestJSON-944917744</nova:project>
Apr 17 15:24:26 user nova-compute[82617]:       </nova:owner>
Apr 17 15:24:26 user nova-compute[82617]:       <nova:root type="image" uuid="911f0f9a-e08e-404e-927e-0239328839b0"/>
Apr 17 15:24:26 user nova-compute[82617]:       <nova:ports>
Apr 17 15:24:26 user nova-compute[82617]:         <nova:port uuid="159f4c8b-7692-4b13-8c6a-884b6ccd8964">
Apr 17 15:24:26 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 17 15:24:26 user nova-compute[82617]:         </nova:port>
Apr 17 15:24:26 user nova-compute[82617]:       </nova:ports>
Apr 17 15:24:26 user nova-compute[82617]:     </nova:instance>
Apr 17 15:24:26 user nova-compute[82617]:   </metadata>
Apr 17 15:24:26 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:24:26 user nova-compute[82617]:     <system>
Apr 17 15:24:26 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:24:26 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:24:26 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:24:26 user nova-compute[82617]:       <entry name="serial">3456d072-ae41-4bd2-bd5d-3622a9a5a23d</entry>
Apr 17 15:24:26 user nova-compute[82617]:       <entry name="uuid">3456d072-ae41-4bd2-bd5d-3622a9a5a23d</entry>
Apr 17 15:24:26 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:24:26 user nova-compute[82617]:     </system>
Apr 17 15:24:26 user nova-compute[82617]:   </sysinfo>
Apr 17 15:24:26 user nova-compute[82617]:   <os>
Apr 17 15:24:26 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:24:26 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:24:26 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:24:26 user nova-compute[82617]:   </os>
Apr 17 15:24:26 user nova-compute[82617]:   <features>
Apr 17 15:24:26 user nova-compute[82617]:     <acpi/>
Apr 17 15:24:26 user nova-compute[82617]:     <apic/>
Apr 17 15:24:26 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:24:26 user nova-compute[82617]:   </features>
Apr 17 15:24:26 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:24:26 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:24:26 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:24:26 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:24:26 user nova-compute[82617]:   </clock>
Apr 17 15:24:26 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:24:26 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:24:26 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:24:26 user nova-compute[82617]:   </cpu>
Apr 17 15:24:26 user nova-compute[82617]:   <devices>
Apr 17 15:24:26 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:24:26 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:24:26 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk"/>
Apr 17 15:24:26 user nova-compute[82617]:       <target dev="sda" bus="scsi"/>
Apr 17 15:24:26 user nova-compute[82617]:       <address type="drive" controller="0" unit="0"/>
Apr 17 15:24:26 user nova-compute[82617]:     </disk>
Apr 17 15:24:26 user nova-compute[82617]:     <disk type="file" device="cdrom">
Apr 17 15:24:26 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none"/>
Apr 17 15:24:26 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk.config"/>
Apr 17 15:24:26 user nova-compute[82617]:       <target dev="sdb" bus="scsi"/>
Apr 17 15:24:26 user nova-compute[82617]:       <address type="drive" controller="0" unit="1"/>
Apr 17 15:24:26 user nova-compute[82617]:     </disk>
Apr 17 15:24:26 user nova-compute[82617]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 17 15:24:26 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:24:26 user nova-compute[82617]:       <mac address="fa:16:3e:dc:73:ba"/>
Apr 17 15:24:26 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:26 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:24:26 user nova-compute[82617]:       <target dev="tap159f4c8b-76"/>
Apr 17 15:24:26 user nova-compute[82617]:     </interface>
Apr 17 15:24:26 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:24:26 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/console.log" append="off"/>
Apr 17 15:24:26 user nova-compute[82617]:     </serial>
Apr 17 15:24:26 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:24:26 user nova-compute[82617]:     <video>
Apr 17 15:24:26 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:26 user nova-compute[82617]:     </video>
Apr 17 15:24:26 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:24:26 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:24:26 user nova-compute[82617]:     </rng>
Apr 17 15:24:26 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:24:26 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:24:26 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:24:26 user nova-compute[82617]:     </memballoon>
Apr 17 15:24:26 user nova-compute[82617]:   </devices>
Apr 17 15:24:26 user nova-compute[82617]: </domain>
Apr 17 15:24:26 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-353147092',display_name='tempest-AttachSCSIVolumeTestJSON-server-353147092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-353147092',id=6,image_ref='911f0f9a-e08e-404e-927e-0239328839b0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMik5YI1BskjrMfwqNYIJSXfH/EglGjrkBEzbJNkzpmFhPDGgkvsbY09Hv08wuU5IlCSf6+ruYbkEIhdfaqNbjxS5QSP3lcxK8A+eOfyf9q3S6JRSK1NK9BfOQHeJN04w==',key_name='tempest-keypair-212722224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fd4ceec29874bc38e8da456cab2048d',ramdisk_id='',reservation_id='r-mq0ucv0z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='911f0f9a-e08e-404e-927e-0239328839b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-944917744',owner_user_name='tempest-AttachSCSIVolumeTestJSON-944917744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1734894909e44118bd60e233dc501a0',uuid=3456d072-ae41-4bd2-bd5d-3622a9a5a23d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Converting VIF {"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:73:ba,bridge_name='br-int',has_traffic_filtering=True,id=159f4c8b-7692-4b13-8c6a-884b6ccd8964,network=Network(bd093d71-00e5-48a6-b9fa-db1d299a5525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f4c8b-76') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG os_vif [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:73:ba,bridge_name='br-int',has_traffic_filtering=True,id=159f4c8b-7692-4b13-8c6a-884b6ccd8964,network=Network(bd093d71-00e5-48a6-b9fa-db1d299a5525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f4c8b-76') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap159f4c8b-76, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap159f4c8b-76, col_values=(('external_ids', {'iface-id': '159f4c8b-7692-4b13-8c6a-884b6ccd8964', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:73:ba', 'vm-uuid': '3456d072-ae41-4bd2-bd5d-3622a9a5a23d'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:24:26 user nova-compute[82617]: INFO os_vif [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:73:ba,bridge_name='br-int',has_traffic_filtering=True,id=159f4c8b-7692-4b13-8c6a-884b6ccd8964,network=Network(bd093d71-00e5-48a6-b9fa-db1d299a5525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f4c8b-76')
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-5538b331-93e9-4693-844b-cad726c27b9f req-d8776b4e-b1b1-4565-91bb-469aad1d2269 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received event network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5538b331-93e9-4693-844b-cad726c27b9f req-d8776b4e-b1b1-4565-91bb-469aad1d2269 service nova] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5538b331-93e9-4693-844b-cad726c27b9f req-d8776b4e-b1b1-4565-91bb-469aad1d2269 service nova] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5538b331-93e9-4693-844b-cad726c27b9f req-d8776b4e-b1b1-4565-91bb-469aad1d2269 service nova] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-5538b331-93e9-4693-844b-cad726c27b9f req-d8776b4e-b1b1-4565-91bb-469aad1d2269 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] No waiting events found dispatching network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:26 user nova-compute[82617]: WARNING nova.compute.manager [req-5538b331-93e9-4693-844b-cad726c27b9f req-d8776b4e-b1b1-4565-91bb-469aad1d2269 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received unexpected event network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d for instance with vm_state building and task_state spawning.
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.255s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] No BDM found with device name sda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] No VIF found with MAC fa:16:3e:dc:73:ba, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:24:26 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Using config drive
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.222s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk 1073741824" returned: 0 in 0.082s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:27 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Creating config drive at /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk.config
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1nmgz5z9 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.181s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1nmgz5z9" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG nova.network.neutron [req-2afdafd7-742e-4e11-a735-f1f0521837fe req-21dd7358-1a1c-439d-9a0d-f5177c5df9f9 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Updated VIF entry in instance network info cache for port 159f4c8b-7692-4b13-8c6a-884b6ccd8964. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG nova.network.neutron [req-2afdafd7-742e-4e11-a735-f1f0521837fe req-21dd7358-1a1c-439d-9a0d-f5177c5df9f9 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Updating instance_info_cache with network_info: [{"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2afdafd7-742e-4e11-a735-f1f0521837fe req-21dd7358-1a1c-439d-9a0d-f5177c5df9f9 service nova] Releasing lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Cannot resize image /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG nova.objects.instance [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'migration_context' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Ensure instance console log exists: /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Skipping network cache update for instance because it is Building. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Skipping network cache update for instance because it is Building. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Skipping network cache update for instance because it is Building. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Skipping network cache update for instance because it is Building. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Successfully updated port: 991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquired lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 70667df1-34e8-4063-a2fc-1fc7d63318f9 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Successfully created port: d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-94df5cb5-0683-4f11-991c-f0e71a9801e0 req-e34ba9ee-f138-455d-b72b-761e89374c6f service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received event network-changed-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-94df5cb5-0683-4f11-991c-f0e71a9801e0 req-e34ba9ee-f138-455d-b72b-761e89374c6f service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Refreshing instance network info cache due to event network-changed-991a008c-046e-454f-a14c-e4a8bed88a6b. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-94df5cb5-0683-4f11-991c-f0e71a9801e0 req-e34ba9ee-f138-455d-b72b-761e89374c6f service nova] Acquiring lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Updating instance_info_cache with network_info: [{"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-be192377-7ee0-41f4-8db2-2ec3c4742f60 req-c4c5603c-a187-4982-a854-1f70d2bb3b96 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received event network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-be192377-7ee0-41f4-8db2-2ec3c4742f60 req-c4c5603c-a187-4982-a854-1f70d2bb3b96 service nova] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-be192377-7ee0-41f4-8db2-2ec3c4742f60 req-c4c5603c-a187-4982-a854-1f70d2bb3b96 service nova] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-be192377-7ee0-41f4-8db2-2ec3c4742f60 req-c4c5603c-a187-4982-a854-1f70d2bb3b96 service nova] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-be192377-7ee0-41f4-8db2-2ec3c4742f60 req-c4c5603c-a187-4982-a854-1f70d2bb3b96 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] No waiting events found dispatching network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:28 user nova-compute[82617]: WARNING nova.compute.manager [req-be192377-7ee0-41f4-8db2-2ec3c4742f60 req-c4c5603c-a187-4982-a854-1f70d2bb3b96 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received unexpected event network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d for instance with vm_state building and task_state spawning.
Apr 17 15:24:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Releasing lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Instance network_info: |[{"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-94df5cb5-0683-4f11-991c-f0e71a9801e0 req-e34ba9ee-f138-455d-b72b-761e89374c6f service nova] Acquired lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.network.neutron [req-94df5cb5-0683-4f11-991c-f0e71a9801e0 req-e34ba9ee-f138-455d-b72b-761e89374c6f service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Refreshing network info cache for port 991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Start _get_guest_xml network_info=[{"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:24:29 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:29 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1148981178',display_name='tempest-TestVolumeSwap-server-1148981178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1148981178',id=7,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCWsWWedP45NVY6melMCfloXXhpMh5fGV6y1NN/gdT8rH9evU45A8Oua8K8r3Edrv6kDHdDvuPQPR/2WOeWraX0i/16D69tRxjdGs8XlvLGkRS3VGSvfTpsa91+XgMpw==',key_name='tempest-keypair-541289283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00b574796d1942938ed2f348803fcf87',ramdisk_id='',reservation_id='r-o72n1m6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1714109745',owner_user_name='tempest-TestVolumeSwap-1714109745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2bfcb4119e483ab1a41e3c598ee1b0',uuid=109c9a23-751e-4b29-abcf-0f003adb35cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Converting VIF {"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:df:aa,bridge_name='br-int',has_traffic_filtering=True,id=991a008c-046e-454f-a14c-e4a8bed88a6b,network=Network(90869163-2b87-480a-ab6d-d12a53663c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991a008c-04') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.objects.instance [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lazy-loading 'pci_devices' on Instance uuid 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:24:29 user nova-compute[82617]:   <uuid>109c9a23-751e-4b29-abcf-0f003adb35cc</uuid>
Apr 17 15:24:29 user nova-compute[82617]:   <name>instance-00000007</name>
Apr 17 15:24:29 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:24:29 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:24:29 user nova-compute[82617]:   <metadata>
Apr 17 15:24:29 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:24:29 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:24:29 user nova-compute[82617]:       <nova:name>tempest-TestVolumeSwap-server-1148981178</nova:name>
Apr 17 15:24:29 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:24:29</nova:creationTime>
Apr 17 15:24:29 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:24:29 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:24:29 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:24:29 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:24:29 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:24:29 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:24:29 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:24:29 user nova-compute[82617]:       <nova:owner>
Apr 17 15:24:29 user nova-compute[82617]:         <nova:user uuid="4c2bfcb4119e483ab1a41e3c598ee1b0">tempest-TestVolumeSwap-1714109745-project-member</nova:user>
Apr 17 15:24:29 user nova-compute[82617]:         <nova:project uuid="00b574796d1942938ed2f348803fcf87">tempest-TestVolumeSwap-1714109745</nova:project>
Apr 17 15:24:29 user nova-compute[82617]:       </nova:owner>
Apr 17 15:24:29 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:24:29 user nova-compute[82617]:       <nova:ports>
Apr 17 15:24:29 user nova-compute[82617]:         <nova:port uuid="991a008c-046e-454f-a14c-e4a8bed88a6b">
Apr 17 15:24:29 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 17 15:24:29 user nova-compute[82617]:         </nova:port>
Apr 17 15:24:29 user nova-compute[82617]:       </nova:ports>
Apr 17 15:24:29 user nova-compute[82617]:     </nova:instance>
Apr 17 15:24:29 user nova-compute[82617]:   </metadata>
Apr 17 15:24:29 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:24:29 user nova-compute[82617]:     <system>
Apr 17 15:24:29 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:24:29 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:24:29 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:24:29 user nova-compute[82617]:       <entry name="serial">109c9a23-751e-4b29-abcf-0f003adb35cc</entry>
Apr 17 15:24:29 user nova-compute[82617]:       <entry name="uuid">109c9a23-751e-4b29-abcf-0f003adb35cc</entry>
Apr 17 15:24:29 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:24:29 user nova-compute[82617]:     </system>
Apr 17 15:24:29 user nova-compute[82617]:   </sysinfo>
Apr 17 15:24:29 user nova-compute[82617]:   <os>
Apr 17 15:24:29 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:24:29 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:24:29 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:24:29 user nova-compute[82617]:   </os>
Apr 17 15:24:29 user nova-compute[82617]:   <features>
Apr 17 15:24:29 user nova-compute[82617]:     <acpi/>
Apr 17 15:24:29 user nova-compute[82617]:     <apic/>
Apr 17 15:24:29 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:24:29 user nova-compute[82617]:   </features>
Apr 17 15:24:29 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:24:29 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:24:29 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:24:29 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:24:29 user nova-compute[82617]:   </clock>
Apr 17 15:24:29 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:24:29 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:24:29 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:24:29 user nova-compute[82617]:   </cpu>
Apr 17 15:24:29 user nova-compute[82617]:   <devices>
Apr 17 15:24:29 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:24:29 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:24:29 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk"/>
Apr 17 15:24:29 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:24:29 user nova-compute[82617]:     </disk>
Apr 17 15:24:29 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:24:29 user nova-compute[82617]:       <mac address="fa:16:3e:70:df:aa"/>
Apr 17 15:24:29 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:29 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:24:29 user nova-compute[82617]:       <target dev="tap991a008c-04"/>
Apr 17 15:24:29 user nova-compute[82617]:     </interface>
Apr 17 15:24:29 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:24:29 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/console.log" append="off"/>
Apr 17 15:24:29 user nova-compute[82617]:     </serial>
Apr 17 15:24:29 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:24:29 user nova-compute[82617]:     <video>
Apr 17 15:24:29 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:29 user nova-compute[82617]:     </video>
Apr 17 15:24:29 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:24:29 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:24:29 user nova-compute[82617]:     </rng>
Apr 17 15:24:29 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:24:29 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:24:29 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:24:29 user nova-compute[82617]:     </memballoon>
Apr 17 15:24:29 user nova-compute[82617]:   </devices>
Apr 17 15:24:29 user nova-compute[82617]: </domain>
Apr 17 15:24:29 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1148981178',display_name='tempest-TestVolumeSwap-server-1148981178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1148981178',id=7,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCWsWWedP45NVY6melMCfloXXhpMh5fGV6y1NN/gdT8rH9evU45A8Oua8K8r3Edrv6kDHdDvuPQPR/2WOeWraX0i/16D69tRxjdGs8XlvLGkRS3VGSvfTpsa91+XgMpw==',key_name='tempest-keypair-541289283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00b574796d1942938ed2f348803fcf87',ramdisk_id='',reservation_id='r-o72n1m6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1714109745',owner_user_name='tempest-TestVolumeSwap-1714109745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2bfcb4119e483ab1a41e3c598ee1b0',uuid=109c9a23-751e-4b29-abcf-0f003adb35cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Converting VIF {"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:df:aa,bridge_name='br-int',has_traffic_filtering=True,id=991a008c-046e-454f-a14c-e4a8bed88a6b,network=Network(90869163-2b87-480a-ab6d-d12a53663c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991a008c-04') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG os_vif [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:df:aa,bridge_name='br-int',has_traffic_filtering=True,id=991a008c-046e-454f-a14c-e4a8bed88a6b,network=Network(90869163-2b87-480a-ab6d-d12a53663c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991a008c-04') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap991a008c-04, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap991a008c-04, col_values=(('external_ids', {'iface-id': '991a008c-046e-454f-a14c-e4a8bed88a6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:df:aa', 'vm-uuid': '109c9a23-751e-4b29-abcf-0f003adb35cc'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: INFO os_vif [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:df:aa,bridge_name='br-int',has_traffic_filtering=True,id=991a008c-046e-454f-a14c-e4a8bed88a6b,network=Network(90869163-2b87-480a-ab6d-d12a53663c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991a008c-04')
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] No VIF found with MAC fa:16:3e:70:df:aa, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745069.507357, df469608-5f17-4f70-8933-fe92adcd3837 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:29 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] VM Resumed (Lifecycle Event)
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:29 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Instance spawned successfully.
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:29 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745069.5102468, df469608-5f17-4f70-8933-fe92adcd3837 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:29 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] VM Started (Lifecycle Event)
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:29 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Updating instance_info_cache with network_info: [{"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:29 user nova-compute[82617]: INFO nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Took 11.57 seconds to spawn the instance on the hypervisor.
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-70667df1-34e8-4063-a2fc-1fc7d63318f9" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:24:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Successfully updated port: d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:24:30 user nova-compute[82617]: INFO nova.compute.manager [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Took 12.92 seconds to build instance.
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquired lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7dcdf71f-6f4d-4316-9e6f-55bc21c95602 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.082s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-acc77a5b-830b-4e5e-b1d9-8b98fa2503e0 req-0d5863d9-bc6c-420e-9f42-7ed380be0382 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-changed-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-acc77a5b-830b-4e5e-b1d9-8b98fa2503e0 req-0d5863d9-bc6c-420e-9f42-7ed380be0382 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Refreshing instance network info cache due to event network-changed-d1c7ec7e-3825-4422-ae8b-82505961b10d. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-acc77a5b-830b-4e5e-b1d9-8b98fa2503e0 req-0d5863d9-bc6c-420e-9f42-7ed380be0382 service nova] Acquiring lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-4eddb42d-5e17-478a-8de0-efb5cbca3027 req-0fdcec92-ccdb-478d-95f5-219d17e553e2 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received event network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-4eddb42d-5e17-478a-8de0-efb5cbca3027 req-0fdcec92-ccdb-478d-95f5-219d17e553e2 service nova] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-4eddb42d-5e17-478a-8de0-efb5cbca3027 req-0fdcec92-ccdb-478d-95f5-219d17e553e2 service nova] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-4eddb42d-5e17-478a-8de0-efb5cbca3027 req-0fdcec92-ccdb-478d-95f5-219d17e553e2 service nova] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-4eddb42d-5e17-478a-8de0-efb5cbca3027 req-0fdcec92-ccdb-478d-95f5-219d17e553e2 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] No waiting events found dispatching network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:30 user nova-compute[82617]: WARNING nova.compute.manager [req-4eddb42d-5e17-478a-8de0-efb5cbca3027 req-0fdcec92-ccdb-478d-95f5-219d17e553e2 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received unexpected event network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 for instance with vm_state building and task_state spawning.
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.neutron [req-94df5cb5-0683-4f11-991c-f0e71a9801e0 req-e34ba9ee-f138-455d-b72b-761e89374c6f service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Updated VIF entry in instance network info cache for port 991a008c-046e-454f-a14c-e4a8bed88a6b. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.neutron [req-94df5cb5-0683-4f11-991c-f0e71a9801e0 req-e34ba9ee-f138-455d-b72b-761e89374c6f service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Updating instance_info_cache with network_info: [{"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-94df5cb5-0683-4f11-991c-f0e71a9801e0 req-e34ba9ee-f138-455d-b72b-761e89374c6f service nova] Releasing lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating instance_info_cache with network_info: [{"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Releasing lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Instance network_info: |[{"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-acc77a5b-830b-4e5e-b1d9-8b98fa2503e0 req-0d5863d9-bc6c-420e-9f42-7ed380be0382 service nova] Acquired lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.neutron [req-acc77a5b-830b-4e5e-b1d9-8b98fa2503e0 req-0d5863d9-bc6c-420e-9f42-7ed380be0382 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Refreshing network info cache for port d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Start _get_guest_xml network_info=[{"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:24:30 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:30 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1823140976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1823140976',id=8,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUfHnESoVXPXi9ptdNvQZ84Ee9hbXkk0ExtIQFN0+4bRf8Gw1SKqE0OkJ3a+urW6oJfBopuykh0VzTN212r/3wGIPauF1zsICIzN843Fa+vOY9Vmjx0m4DGpvIcKrqkuQ==',key_name='tempest-keypair-201206862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dfa73323c3c4c689f4012505d8b4833',ramdisk_id='',reservation_id='r-f1zz6xdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1309189231',owner_user_name='tempest-TaggedAttachmentsTest-1309189231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f081ecb75ec14053b68d74cacf61c802',uuid=c1fafed5-dcf8-4bac-8b38-f2067e47bd1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converting VIF {"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1c7ec7e-3825-4422-ae8b-82505961b10d,network=Network(a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c7ec7e-38') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.objects.instance [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'pci_devices' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:24:30 user nova-compute[82617]:   <uuid>c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</uuid>
Apr 17 15:24:30 user nova-compute[82617]:   <name>instance-00000008</name>
Apr 17 15:24:30 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:24:30 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:24:30 user nova-compute[82617]:   <metadata>
Apr 17 15:24:30 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:24:30 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:24:30 user nova-compute[82617]:       <nova:name>tempest-device-tagging-server-1823140976</nova:name>
Apr 17 15:24:30 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:24:30</nova:creationTime>
Apr 17 15:24:30 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:24:30 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:24:30 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:24:30 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:24:30 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:24:30 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:24:30 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:24:30 user nova-compute[82617]:       <nova:owner>
Apr 17 15:24:30 user nova-compute[82617]:         <nova:user uuid="f081ecb75ec14053b68d74cacf61c802">tempest-TaggedAttachmentsTest-1309189231-project-member</nova:user>
Apr 17 15:24:30 user nova-compute[82617]:         <nova:project uuid="9dfa73323c3c4c689f4012505d8b4833">tempest-TaggedAttachmentsTest-1309189231</nova:project>
Apr 17 15:24:30 user nova-compute[82617]:       </nova:owner>
Apr 17 15:24:30 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:24:30 user nova-compute[82617]:       <nova:ports>
Apr 17 15:24:30 user nova-compute[82617]:         <nova:port uuid="d1c7ec7e-3825-4422-ae8b-82505961b10d">
Apr 17 15:24:30 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 15:24:30 user nova-compute[82617]:         </nova:port>
Apr 17 15:24:30 user nova-compute[82617]:       </nova:ports>
Apr 17 15:24:30 user nova-compute[82617]:     </nova:instance>
Apr 17 15:24:30 user nova-compute[82617]:   </metadata>
Apr 17 15:24:30 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:24:30 user nova-compute[82617]:     <system>
Apr 17 15:24:30 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:24:30 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:24:30 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:24:30 user nova-compute[82617]:       <entry name="serial">c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</entry>
Apr 17 15:24:30 user nova-compute[82617]:       <entry name="uuid">c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</entry>
Apr 17 15:24:30 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:24:30 user nova-compute[82617]:     </system>
Apr 17 15:24:30 user nova-compute[82617]:   </sysinfo>
Apr 17 15:24:30 user nova-compute[82617]:   <os>
Apr 17 15:24:30 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:24:30 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:24:30 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:24:30 user nova-compute[82617]:   </os>
Apr 17 15:24:30 user nova-compute[82617]:   <features>
Apr 17 15:24:30 user nova-compute[82617]:     <acpi/>
Apr 17 15:24:30 user nova-compute[82617]:     <apic/>
Apr 17 15:24:30 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:24:30 user nova-compute[82617]:   </features>
Apr 17 15:24:30 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:24:30 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:24:30 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:24:30 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:24:30 user nova-compute[82617]:   </clock>
Apr 17 15:24:30 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:24:30 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:24:30 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:24:30 user nova-compute[82617]:   </cpu>
Apr 17 15:24:30 user nova-compute[82617]:   <devices>
Apr 17 15:24:30 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:24:30 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:24:30 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk"/>
Apr 17 15:24:30 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:24:30 user nova-compute[82617]:     </disk>
Apr 17 15:24:30 user nova-compute[82617]:     <disk type="file" device="cdrom">
Apr 17 15:24:30 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none"/>
Apr 17 15:24:30 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.config"/>
Apr 17 15:24:30 user nova-compute[82617]:       <target dev="hda" bus="ide"/>
Apr 17 15:24:30 user nova-compute[82617]:     </disk>
Apr 17 15:24:30 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:24:30 user nova-compute[82617]:       <mac address="fa:16:3e:cb:da:dc"/>
Apr 17 15:24:30 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:30 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:24:30 user nova-compute[82617]:       <target dev="tapd1c7ec7e-38"/>
Apr 17 15:24:30 user nova-compute[82617]:     </interface>
Apr 17 15:24:30 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:24:30 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/console.log" append="off"/>
Apr 17 15:24:30 user nova-compute[82617]:     </serial>
Apr 17 15:24:30 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:24:30 user nova-compute[82617]:     <video>
Apr 17 15:24:30 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:24:30 user nova-compute[82617]:     </video>
Apr 17 15:24:30 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:24:30 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:24:30 user nova-compute[82617]:     </rng>
Apr 17 15:24:30 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:24:30 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:24:30 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:24:30 user nova-compute[82617]:     </memballoon>
Apr 17 15:24:30 user nova-compute[82617]:   </devices>
Apr 17 15:24:30 user nova-compute[82617]: </domain>
Apr 17 15:24:30 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1823140976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1823140976',id=8,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUfHnESoVXPXi9ptdNvQZ84Ee9hbXkk0ExtIQFN0+4bRf8Gw1SKqE0OkJ3a+urW6oJfBopuykh0VzTN212r/3wGIPauF1zsICIzN843Fa+vOY9Vmjx0m4DGpvIcKrqkuQ==',key_name='tempest-keypair-201206862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dfa73323c3c4c689f4012505d8b4833',ramdisk_id='',reservation_id='r-f1zz6xdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1309189231',owner_user_name='tempest-TaggedAttachmentsTest-1309189231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f081ecb75ec14053b68d74cacf61c802',uuid=c1fafed5-dcf8-4bac-8b38-f2067e47bd1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converting VIF {"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1c7ec7e-3825-4422-ae8b-82505961b10d,network=Network(a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c7ec7e-38') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG os_vif [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1c7ec7e-3825-4422-ae8b-82505961b10d,network=Network(a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c7ec7e-38') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1c7ec7e-38, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1c7ec7e-38, col_values=(('external_ids', {'iface-id': 'd1c7ec7e-3825-4422-ae8b-82505961b10d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:da:dc', 'vm-uuid': 'c1fafed5-dcf8-4bac-8b38-f2067e47bd1c'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:30 user nova-compute[82617]: INFO os_vif [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1c7ec7e-3825-4422-ae8b-82505961b10d,network=Network(a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c7ec7e-38')
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No BDM found with device name hda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:24:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No VIF found with MAC fa:16:3e:cb:da:dc, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:24:30 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Using config drive
Apr 17 15:24:31 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Creating config drive at /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.config
Apr 17 15:24:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp56k2s9cs {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp56k2s9cs" returned: 0 in 0.063s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:31 user nova-compute[82617]: DEBUG nova.network.neutron [req-acc77a5b-830b-4e5e-b1d9-8b98fa2503e0 req-0d5863d9-bc6c-420e-9f42-7ed380be0382 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updated VIF entry in instance network info cache for port d1c7ec7e-3825-4422-ae8b-82505961b10d. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:24:31 user nova-compute[82617]: DEBUG nova.network.neutron [req-acc77a5b-830b-4e5e-b1d9-8b98fa2503e0 req-0d5863d9-bc6c-420e-9f42-7ed380be0382 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating instance_info_cache with network_info: [{"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-acc77a5b-830b-4e5e-b1d9-8b98fa2503e0 req-0d5863d9-bc6c-420e-9f42-7ed380be0382 service nova] Releasing lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received event network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] No waiting events found dispatching network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:32 user nova-compute[82617]: WARNING nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received unexpected event network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 for instance with vm_state building and task_state spawning.
Apr 17 15:24:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received event network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] No waiting events found dispatching network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:32 user nova-compute[82617]: WARNING nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received unexpected event network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b for instance with vm_state building and task_state spawning.
Apr 17 15:24:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received event network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] No waiting events found dispatching network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:32 user nova-compute[82617]: WARNING nova.compute.manager [req-7796ae85-acc3-4819-80fd-63830ac90a0c req-34329a6e-3356-47be-bf52-5e1314e04ab8 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received unexpected event network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b for instance with vm_state building and task_state spawning.
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745073.2751868, 3456d072-ae41-4bd2-bd5d-3622a9a5a23d => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] VM Resumed (Lifecycle Event)
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:33 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Instance spawned successfully.
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745073.2755861, 3456d072-ae41-4bd2-bd5d-3622a9a5a23d => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] VM Started (Lifecycle Event)
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:33 user nova-compute[82617]: INFO nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Took 9.95 seconds to spawn the instance on the hypervisor.
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:33 user nova-compute[82617]: INFO nova.compute.manager [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Took 11.34 seconds to build instance.
Apr 17 15:24:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4488eee1-b3dd-4575-9054-49ef2858ea9d tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.512s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-447b515e-462f-432b-a771-7b2d14db119b req-77f74dd5-cf2f-4391-aefe-c752db233a43 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-447b515e-462f-432b-a771-7b2d14db119b req-77f74dd5-cf2f-4391-aefe-c752db233a43 service nova] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-447b515e-462f-432b-a771-7b2d14db119b req-77f74dd5-cf2f-4391-aefe-c752db233a43 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-447b515e-462f-432b-a771-7b2d14db119b req-77f74dd5-cf2f-4391-aefe-c752db233a43 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG nova.compute.manager [req-447b515e-462f-432b-a771-7b2d14db119b req-77f74dd5-cf2f-4391-aefe-c752db233a43 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] No waiting events found dispatching network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:34 user nova-compute[82617]: WARNING nova.compute.manager [req-447b515e-462f-432b-a771-7b2d14db119b req-77f74dd5-cf2f-4391-aefe-c752db233a43 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received unexpected event network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d for instance with vm_state building and task_state spawning.
Apr 17 15:24:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-1e8743b2-57f4-45b4-ad80-655d5d2f483c req-fed55bd6-1b42-4c62-a854-e806f7df2c44 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1e8743b2-57f4-45b4-ad80-655d5d2f483c req-fed55bd6-1b42-4c62-a854-e806f7df2c44 service nova] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1e8743b2-57f4-45b4-ad80-655d5d2f483c req-fed55bd6-1b42-4c62-a854-e806f7df2c44 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1e8743b2-57f4-45b4-ad80-655d5d2f483c req-fed55bd6-1b42-4c62-a854-e806f7df2c44 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-1e8743b2-57f4-45b4-ad80-655d5d2f483c req-fed55bd6-1b42-4c62-a854-e806f7df2c44 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] No waiting events found dispatching network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:24:36 user nova-compute[82617]: WARNING nova.compute.manager [req-1e8743b2-57f4-45b4-ad80-655d5d2f483c req-fed55bd6-1b42-4c62-a854-e806f7df2c44 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received unexpected event network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d for instance with vm_state building and task_state spawning.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745076.1933541, 109c9a23-751e-4b29-abcf-0f003adb35cc => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] VM Resumed (Lifecycle Event)
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Instance spawned successfully.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Instance spawned successfully.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745076.194496, 109c9a23-751e-4b29-abcf-0f003adb35cc => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] VM Started (Lifecycle Event)
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Took 11.86 seconds to spawn the instance on the hypervisor.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745076.2302246, c1fafed5-dcf8-4bac-8b38-f2067e47bd1c => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] VM Resumed (Lifecycle Event)
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Took 9.99 seconds to spawn the instance on the hypervisor.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745076.2366903, c1fafed5-dcf8-4bac-8b38-f2067e47bd1c => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] VM Started (Lifecycle Event)
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Took 14.15 seconds to build instance.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-67ac9044-6ce2-4c35-8c12-c643a48d4841 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.374s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:36 user nova-compute[82617]: INFO nova.compute.manager [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Took 12.84 seconds to build instance.
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ea2df986-9f9d-40ad-b6d9-542039954cfe tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.249s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:38 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:38 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8004MB free_disk=26.676692962646484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 70667df1-34e8-4063-a2fc-1fc7d63318f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 109c9a23-751e-4b29-abcf-0f003adb35cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:24:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.327s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:24:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:24:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:24:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:24:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:24:53 user nova-compute[82617]: INFO nova.compute.claims [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Claim successful on node user
Apr 17 15:24:53 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:24:53 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:24:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:24:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:24:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:24:54 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:24:54 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:24:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:24:54 user nova-compute[82617]: INFO nova.virt.block_device [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Booting with volume c74b7878-4936-4015-8b63-142923947310 at /dev/vda
Apr 17 15:24:54 user nova-compute[82617]: DEBUG nova.policy [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e4b069991954c57993051fbe8665d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0c848b490b47629051e961c682c5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:24:54 user nova-compute[82617]: DEBUG os_brick.utils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:24:54 user nova-compute[82617]: INFO oslo.privsep.daemon [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpiadk5nlz/privsep.sock']
Apr 17 15:24:54 user sudo[92889]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpiadk5nlz/privsep.sock
Apr 17 15:24:54 user sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 17 15:24:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:55 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully created port: 735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:55 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully created port: 6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:56 user sudo[92889]: pam_unix(sudo:session): session closed for user root
Apr 17 15:24:56 user nova-compute[82617]: INFO oslo.privsep.daemon [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Spawned new privsep daemon via rootwrap
Apr 17 15:24:56 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 17 15:24:56 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 17 15:24:56 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 17 15:24:56 user nova-compute[82617]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92892
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7107c-c526-4e0a-bbc4-cd024427f446]: (2,) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af73553-9360-4e25-9173-9f143b63a785]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:24:56 user nova-compute[82617]: WARNING os_brick.initiator.connectors.nvmeof [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8377454e-824c-4a06-a45d-6c0e7e3bf694]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ba0e00-e742-47a9-a584-c9f38aec1f10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa27efc3-0eae-41cc-891c-689f61797400]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully created port: 016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:24:56 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:24:56 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[26943683-93df-493b-a0ca-f51afb926d82]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG os_brick.utils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== get_connector_properties: return (2269ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:24:56 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating existing volume attachment record: e51e7201-04a3-43d8-b3a0-c7467cb02c04 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:24:57 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully created port: a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:58 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully created port: 18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully updated port: 735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-d8c22297-afa6-412f-970e-13ab2b9e303a req-65a1a84e-d535-45f8-b9af-c4900bdabafa service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-changed-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-d8c22297-afa6-412f-970e-13ab2b9e303a req-65a1a84e-d535-45f8-b9af-c4900bdabafa service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing instance network info cache due to event network-changed-735ea25c-24c9-40de-8245-af769da97133. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d8c22297-afa6-412f-970e-13ab2b9e303a req-65a1a84e-d535-45f8-b9af-c4900bdabafa service nova] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d8c22297-afa6-412f-970e-13ab2b9e303a req-65a1a84e-d535-45f8-b9af-c4900bdabafa service nova] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG nova.network.neutron [req-d8c22297-afa6-412f-970e-13ab2b9e303a req-65a1a84e-d535-45f8-b9af-c4900bdabafa service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing network info cache for port 735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG nova.network.neutron [req-d8c22297-afa6-412f-970e-13ab2b9e303a req-65a1a84e-d535-45f8-b9af-c4900bdabafa service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG nova.network.neutron [req-d8c22297-afa6-412f-970e-13ab2b9e303a req-65a1a84e-d535-45f8-b9af-c4900bdabafa service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:24:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d8c22297-afa6-412f-970e-13ab2b9e303a req-65a1a84e-d535-45f8-b9af-c4900bdabafa service nova] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:00 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully updated port: eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:25:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully updated port: a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-changed-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing instance network info cache due to event network-changed-eed93fad-9763-444d-8483-d4eaeaad3e77. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.network.neutron [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing network info cache for port eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.network.neutron [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.network.neutron [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-changed-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing instance network info cache due to event network-changed-a5b50853-da53-409a-9a0f-259f9f383098. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:01 user nova-compute[82617]: DEBUG nova.network.neutron [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing network info cache for port a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:02 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully updated port: 6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:25:02 user nova-compute[82617]: DEBUG nova.network.neutron [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:25:02 user nova-compute[82617]: DEBUG nova.network.neutron [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d167465b-40b0-446f-bb9c-b61c746bedd4 req-c15cfe4a-3cda-4906-9901-f784c7b09a45 service nova] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully updated port: 016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:25:03 user nova-compute[82617]: INFO nova.virt.block_device [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Booting with volume 18475864-c202-4937-b18f-cc3e16c6d89f at /dev/vdb
Apr 17 15:25:03 user nova-compute[82617]: DEBUG os_brick.utils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b922ed61-86c9-4353-a2de-d9ff00c21fb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f739c2-2325-43b5-8f84-078f1ba62387]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71454c-0028-449c-ad8d-3307b2a4540f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d884e1-0f22-4fc9-9824-b9433df62bd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:25:03 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f12afe6-f019-4291-986d-10c99a8f850f]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG os_brick.utils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating existing volume attachment record: d21f5ce0-237b-4771-ac96-cb17b8159c18 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-changed-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing instance network info cache due to event network-changed-6cc8e19e-8229-4a2d-990d-b9c432ff3e38. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.network.neutron [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing network info cache for port 6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.network.neutron [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.network.neutron [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-changed-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing instance network info cache due to event network-changed-016c7245-66e3-42b3-9966-eedb6386be5d. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.network.neutron [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing network info cache for port 016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully updated port: a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f16b6935-7e97-4a55-9991-00a5dbef3076 req-3b3ede0c-b4b9-4d27-9eb8-e0f0f61ea7bb service nova] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Successfully updated port: 18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:25:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:25:05 user nova-compute[82617]: DEBUG nova.compute.manager [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-changed-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:05 user nova-compute[82617]: DEBUG nova.compute.manager [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing instance network info cache due to event network-changed-a2e8b33f-8d89-4333-8921-722aba13278b. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:07 user nova-compute[82617]: DEBUG nova.network.neutron [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [{"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:07 user nova-compute[82617]: DEBUG nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance network_info: |[{"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:25:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:07 user nova-compute[82617]: DEBUG nova.network.neutron [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing network info cache for port a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updated VIF entry in instance network info cache for port a2e8b33f-8d89-4333-8921-722aba13278b. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [{"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-changed-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing instance network info cache due to event network-changed-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing network info cache for port 18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updated VIF entry in instance network info cache for port 18d9c10b-cff8-4cc5-9301-78d0d5a1dba7. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [{"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd0c382-e1c9-49f3-9fc6-806c3e14e5c6 req-cf8fa626-cdc2-41b6-8590-7383c76b9403 service nova] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:09 user nova-compute[82617]: INFO nova.virt.block_device [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Booting with volume 65a7c5eb-3af6-4afd-918f-ccb69a68641c at /dev/vdc
Apr 17 15:25:09 user nova-compute[82617]: DEBUG os_brick.utils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab08c944-a141-4483-9b8b-aa30520a10d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59c8a68-7c7d-4fb0-938e-cb8844a91d04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7450122-0e9b-4a3a-9c7d-6e982b0f59c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[94900de5-047c-4ca4-b16e-e4a1673139bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:25:09 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:25:09 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a24ef8-cf42-42c1-a7cb-f62e21651599]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG os_brick.utils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:09 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating existing volume attachment record: c57372fa-5821-4a41-9048-fb252947e1d0 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:25:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:25:15 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Creating image(s)
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Did not create local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Ensure instance console log exists: /opt/stack/data/nova/instances/ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Start _get_guest_xml network_info=[{"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvXoCNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c74b7878-4936-4015-8b63-142923947310', 'serial': 'c74b7878-4936-4015-8b63-142923947310'}, 'device_type': 'disk', 'attachment_id': 'e51e7201-04a3-43d8-b3a0-c7467cb02c04', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmlSchIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d', 'attached_at': '', 'detached_at': '', 'volume_id': '18475864-c202-4937-b18f-cc3e16c6d89f', 'serial': '18475864-c202-4937-b18f-cc3e16c6d89f'}, 'device_type': 'disk', 'attachment_id': 'd21f5ce0-237b-4771-ac96-cb17b8159c18', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouATrvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d', 'attached_at': '', 'detached_at': '', 'volume_id': '65a7c5eb-3af6-4afd-918f-ccb69a68641c', 'serial': '65a7c5eb-3af6-4afd-918f-ccb69a68641c'}, 'device_type': 'disk', 'attachment_id': 'c57372fa-5821-4a41-9048-fb252947e1d0', 'volume_type': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:25:15 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:25:15 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connector [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Factory for ISCSI on None {{(pid=82617) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvXoCNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:15 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:15 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:15 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da4d595-83df-494e-8c8f-7d16cabfb4dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:25:15 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c227c61f-cb4a-4a91-b13a-f806efe68361]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310] added
Apr 17 15:25:15 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f02a280-7633-4ef6-833e-bd7a601f4548]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade5ba81-0640-47f7-b5a1-e0d87e6af501]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUvXoCNO {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUvXoCNO" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c6c95e-07ed-4f73-b11b-095ba2e716ae]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUvXoCNO'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[753c11f0-404d-4efa-b3af-58cd13802af6]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f0b2b9-58ed-4609-890f-9b87c7969a90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 15:25:15 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 15:25:15 user nova-compute[82617]:  {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:15 user nova-compute[82617]: WARNING os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 15:25:15 user nova-compute[82617]: 
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2037c355-61c1-4628-a084-ff42e0c63145]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310, portal: 172.16.0.220,3260]
Apr 17 15:25:15 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310, portal: 172.16.0.220,3260] successful.
Apr 17 15:25:15 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[112e3ac1-a2e5-4f8d-8828-d4539135bf1b]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ac586f-646a-4407-baa9-1c27504d627a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:15 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:15 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[de202f51-8c57-4687-bbcf-37e28b8bea18]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvXoCNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:25:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26132396565663337', 'path': '/dev/sdb'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132396565663337', 'path': '/dev/sdb'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmlSchIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:16 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:16 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:16 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[131bec69-4457-42d1-828d-6b832bdfaac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:25:16 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5a192-0d4f-4c02-885d-1b27c3e7d5aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f] added
Apr 17 15:25:16 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3472b7-c1a5-4d45-89fa-04d9140ad4e4]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc716f1f-8ec9-4b39-a6b2-7f2be0de0197]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmlSchIr {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmlSchIr" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b82506-d723-4ebc-a758-94fa9c5a0141]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pmlSchIr'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[16407881-fe64-4539-8b3d-151bbc8bfbe0]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56c657f-2ffe-4dc5-9e06-bb8bdec025f8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:16 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:16 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8ada11-959d-4405-b6bf-fb03be007efe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f, portal: 172.16.0.220,3260]
Apr 17 15:25:16 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f, portal: 172.16.0.220,3260] successful.
Apr 17 15:25:16 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[6131354b-4b47-47f7-8d3b-7aa00592ab49]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab1a30-7aee-4831-856d-6f7c7a4bcef8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:16 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:16 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:16 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:16 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dfa9e2-6e61-460c-94d0-a348db42f869]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:25:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmlSchIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23861343637336131', 'path': '/dev/sdc'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861343637336131', 'path': '/dev/sdc'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouATrvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:17 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:17 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:17 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:25:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5772152e-babe-4e67-b531-38160546e14b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:25:17 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef81507f-5f6b-4efc-a6da-07e68e287065]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c] added
Apr 17 15:25:17 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9ad4ab-0807-44f1-9b26-37e6acf41842]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd295624-db86-4acb-b9c1-af0b9090ed23]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wouATrvO {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wouATrvO" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf56e1ea-2d01-4151-ba4e-795b0278e236]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wouATrvO'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319fb71-dcab-4b51-9708-1d52633de892]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc9b0cd-b2e5-4a75-be51-ec10118b1e60]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:18 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:18 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:18 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:18 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[53241db8-8505-4183-974e-9cb86d0dcb25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c, portal: 172.16.0.220,3260]
Apr 17 15:25:18 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c, portal: 172.16.0.220,3260] successful.
Apr 17 15:25:18 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf5d815-8d58-4c82-b62a-fad558aa1b42]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27b5202-c42d-40fb-853b-18fb64259237]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:18 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:18 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:18 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:18 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:18 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:18 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc226d3-1f7b-499c-a852-0e75dc49c931]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:25:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouATrvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "ddc8a602-70e9-4697-b75b-c602ad4c2447" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23064666433666363', 'path': '/dev/sdd'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064666433666363', 'path': '/dev/sdd'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:66:67,bridge_name='br-int',has_traffic_filtering=True,id=735ea25c-24c9-40de-8245-af769da97133,network=Network(cb2880f9-1c09-4f2d-9f5a-80b58e430388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735ea25c-24') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=eed93fad-9763-444d-8483-d4eaeaad3e77,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed93fad-97') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=a5b50853-da53-409a-9a0f-259f9f383098,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5b50853-da') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=6cc8e19e-8229-4a2d-990d-b9c432ff3e38,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc8e19e-82') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bb:b1,bridge_name='br-int',has_traffic_filtering=True,id=016c7245-66e3-42b3-9966-eedb6386be5d,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016c7245-66') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:25:90,bridge_name='br-int',has_traffic_filtering=True,id=a2e8b33f-8d89-4333-8921-722aba13278b,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e8b33f-8d') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=18d9c10b-cff8-4cc5-9301-78d0d5a1dba7,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d9c10b-cf') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.objects.instance [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lazy-loading 'pci_devices' on Instance uuid ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:25:19 user nova-compute[82617]: INFO nova.compute.claims [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Claim successful on node user
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:25:19 user nova-compute[82617]:   <uuid>ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d</uuid>
Apr 17 15:25:19 user nova-compute[82617]:   <name>instance-00000009</name>
Apr 17 15:25:19 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:25:19 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:25:19 user nova-compute[82617]:   <metadata>
Apr 17 15:25:19 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:25:19 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:25:19 user nova-compute[82617]:       <nova:name>tempest-device-tagging-server-1940058976</nova:name>
Apr 17 15:25:19 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:25:15</nova:creationTime>
Apr 17 15:25:19 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:25:19 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:25:19 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:25:19 user nova-compute[82617]:       <nova:owner>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:user uuid="3e4b069991954c57993051fbe8665d35">tempest-TaggedBootDevicesTest_v242-1317742003-project-member</nova:user>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:project uuid="8f0c848b490b47629051e961c682c5a5">tempest-TaggedBootDevicesTest_v242-1317742003</nova:project>
Apr 17 15:25:19 user nova-compute[82617]:       </nova:owner>
Apr 17 15:25:19 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:25:19 user nova-compute[82617]:       <nova:ports>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:port uuid="735ea25c-24c9-40de-8245-af769da97133">
Apr 17 15:25:19 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 15:25:19 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:port uuid="eed93fad-9763-444d-8483-d4eaeaad3e77">
Apr 17 15:25:19 user nova-compute[82617]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Apr 17 15:25:19 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:port uuid="a5b50853-da53-409a-9a0f-259f9f383098">
Apr 17 15:25:19 user nova-compute[82617]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Apr 17 15:25:19 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:port uuid="6cc8e19e-8229-4a2d-990d-b9c432ff3e38">
Apr 17 15:25:19 user nova-compute[82617]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Apr 17 15:25:19 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:port uuid="016c7245-66e3-42b3-9966-eedb6386be5d">
Apr 17 15:25:19 user nova-compute[82617]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Apr 17 15:25:19 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:port uuid="a2e8b33f-8d89-4333-8921-722aba13278b">
Apr 17 15:25:19 user nova-compute[82617]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 17 15:25:19 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:19 user nova-compute[82617]:         <nova:port uuid="18d9c10b-cff8-4cc5-9301-78d0d5a1dba7">
Apr 17 15:25:19 user nova-compute[82617]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 17 15:25:19 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:19 user nova-compute[82617]:       </nova:ports>
Apr 17 15:25:19 user nova-compute[82617]:     </nova:instance>
Apr 17 15:25:19 user nova-compute[82617]:   </metadata>
Apr 17 15:25:19 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:25:19 user nova-compute[82617]:     <system>
Apr 17 15:25:19 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:25:19 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:25:19 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:25:19 user nova-compute[82617]:       <entry name="serial">ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d</entry>
Apr 17 15:25:19 user nova-compute[82617]:       <entry name="uuid">ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d</entry>
Apr 17 15:25:19 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:25:19 user nova-compute[82617]:     </system>
Apr 17 15:25:19 user nova-compute[82617]:   </sysinfo>
Apr 17 15:25:19 user nova-compute[82617]:   <os>
Apr 17 15:25:19 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:25:19 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:25:19 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:25:19 user nova-compute[82617]:   </os>
Apr 17 15:25:19 user nova-compute[82617]:   <features>
Apr 17 15:25:19 user nova-compute[82617]:     <acpi/>
Apr 17 15:25:19 user nova-compute[82617]:     <apic/>
Apr 17 15:25:19 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:25:19 user nova-compute[82617]:   </features>
Apr 17 15:25:19 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:25:19 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:25:19 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:25:19 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:25:19 user nova-compute[82617]:   </clock>
Apr 17 15:25:19 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:25:19 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:25:19 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:25:19 user nova-compute[82617]:   </cpu>
Apr 17 15:25:19 user nova-compute[82617]:   <devices>
Apr 17 15:25:19 user nova-compute[82617]:     <disk type="file" device="cdrom">
Apr 17 15:25:19 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none"/>
Apr 17 15:25:19 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d/disk.config"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="hda" bus="ide"/>
Apr 17 15:25:19 user nova-compute[82617]:     </disk>
Apr 17 15:25:19 user nova-compute[82617]:     <disk type="block" device="disk">
Apr 17 15:25:19 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:25:19 user nova-compute[82617]:       <source dev="/dev/sdb"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <serial>c74b7878-4936-4015-8b63-142923947310</serial>
Apr 17 15:25:19 user nova-compute[82617]:     </disk>
Apr 17 15:25:19 user nova-compute[82617]:     <disk type="block" device="disk">
Apr 17 15:25:19 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:25:19 user nova-compute[82617]:       <source dev="/dev/sdc"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="vdb" bus="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <serial>18475864-c202-4937-b18f-cc3e16c6d89f</serial>
Apr 17 15:25:19 user nova-compute[82617]:     </disk>
Apr 17 15:25:19 user nova-compute[82617]:     <disk type="block" device="disk">
Apr 17 15:25:19 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:25:19 user nova-compute[82617]:       <source dev="/dev/sdd"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="vdc" bus="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <serial>65a7c5eb-3af6-4afd-918f-ccb69a68641c</serial>
Apr 17 15:25:19 user nova-compute[82617]:     </disk>
Apr 17 15:25:19 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:19 user nova-compute[82617]:       <mac address="fa:16:3e:84:66:67"/>
Apr 17 15:25:19 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="tap735ea25c-24"/>
Apr 17 15:25:19 user nova-compute[82617]:     </interface>
Apr 17 15:25:19 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:19 user nova-compute[82617]:       <mac address="fa:16:3e:ad:2c:4e"/>
Apr 17 15:25:19 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="tapeed93fad-97"/>
Apr 17 15:25:19 user nova-compute[82617]:     </interface>
Apr 17 15:25:19 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:19 user nova-compute[82617]:       <mac address="fa:16:3e:0c:06:f1"/>
Apr 17 15:25:19 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="tapa5b50853-da"/>
Apr 17 15:25:19 user nova-compute[82617]:     </interface>
Apr 17 15:25:19 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:19 user nova-compute[82617]:       <mac address="fa:16:3e:82:90:c5"/>
Apr 17 15:25:19 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="tap6cc8e19e-82"/>
Apr 17 15:25:19 user nova-compute[82617]:     </interface>
Apr 17 15:25:19 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:19 user nova-compute[82617]:       <mac address="fa:16:3e:1d:bb:b1"/>
Apr 17 15:25:19 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="tap016c7245-66"/>
Apr 17 15:25:19 user nova-compute[82617]:     </interface>
Apr 17 15:25:19 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:19 user nova-compute[82617]:       <mac address="fa:16:3e:04:25:90"/>
Apr 17 15:25:19 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="tapa2e8b33f-8d"/>
Apr 17 15:25:19 user nova-compute[82617]:     </interface>
Apr 17 15:25:19 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:19 user nova-compute[82617]:       <mac address="fa:16:3e:c7:7f:09"/>
Apr 17 15:25:19 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:19 user nova-compute[82617]:       <target dev="tap18d9c10b-cf"/>
Apr 17 15:25:19 user nova-compute[82617]:     </interface>
Apr 17 15:25:19 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:25:19 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d/console.log" append="off"/>
Apr 17 15:25:19 user nova-compute[82617]:     </serial>
Apr 17 15:25:19 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:25:19 user nova-compute[82617]:     <video>
Apr 17 15:25:19 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:19 user nova-compute[82617]:     </video>
Apr 17 15:25:19 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:25:19 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:25:19 user nova-compute[82617]:     </rng>
Apr 17 15:25:19 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:25:19 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:25:19 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:25:19 user nova-compute[82617]:     </memballoon>
Apr 17 15:25:19 user nova-compute[82617]:   </devices>
Apr 17 15:25:19 user nova-compute[82617]: </domain>
Apr 17 15:25:19 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:66:67,bridge_name='br-int',has_traffic_filtering=True,id=735ea25c-24c9-40de-8245-af769da97133,network=Network(cb2880f9-1c09-4f2d-9f5a-80b58e430388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735ea25c-24') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:66:67,bridge_name='br-int',has_traffic_filtering=True,id=735ea25c-24c9-40de-8245-af769da97133,network=Network(cb2880f9-1c09-4f2d-9f5a-80b58e430388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735ea25c-24') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap735ea25c-24, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap735ea25c-24, col_values=(('external_ids', {'iface-id': '735ea25c-24c9-40de-8245-af769da97133', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:66:67', 'vm-uuid': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: INFO os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:66:67,bridge_name='br-int',has_traffic_filtering=True,id=735ea25c-24c9-40de-8245-af769da97133,network=Network(cb2880f9-1c09-4f2d-9f5a-80b58e430388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735ea25c-24')
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=eed93fad-9763-444d-8483-d4eaeaad3e77,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed93fad-97') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=eed93fad-9763-444d-8483-d4eaeaad3e77,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed93fad-97') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeed93fad-97, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeed93fad-97, col_values=(('external_ids', {'iface-id': 'eed93fad-9763-444d-8483-d4eaeaad3e77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:2c:4e', 'vm-uuid': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: INFO os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=eed93fad-9763-444d-8483-d4eaeaad3e77,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed93fad-97')
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=a5b50853-da53-409a-9a0f-259f9f383098,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5b50853-da') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=a5b50853-da53-409a-9a0f-259f9f383098,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5b50853-da') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5b50853-da, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5b50853-da, col_values=(('external_ids', {'iface-id': 'a5b50853-da53-409a-9a0f-259f9f383098', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:06:f1', 'vm-uuid': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: INFO os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=a5b50853-da53-409a-9a0f-259f9f383098,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5b50853-da')
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=6cc8e19e-8229-4a2d-990d-b9c432ff3e38,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc8e19e-82') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=6cc8e19e-8229-4a2d-990d-b9c432ff3e38,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc8e19e-82') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cc8e19e-82, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cc8e19e-82, col_values=(('external_ids', {'iface-id': '6cc8e19e-8229-4a2d-990d-b9c432ff3e38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:90:c5', 'vm-uuid': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: INFO os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=6cc8e19e-8229-4a2d-990d-b9c432ff3e38,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc8e19e-82')
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bb:b1,bridge_name='br-int',has_traffic_filtering=True,id=016c7245-66e3-42b3-9966-eedb6386be5d,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016c7245-66') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bb:b1,bridge_name='br-int',has_traffic_filtering=True,id=016c7245-66e3-42b3-9966-eedb6386be5d,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016c7245-66') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap016c7245-66, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap016c7245-66, col_values=(('external_ids', {'iface-id': '016c7245-66e3-42b3-9966-eedb6386be5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:bb:b1', 'vm-uuid': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: INFO os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bb:b1,bridge_name='br-int',has_traffic_filtering=True,id=016c7245-66e3-42b3-9966-eedb6386be5d,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016c7245-66')
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:25:90,bridge_name='br-int',has_traffic_filtering=True,id=a2e8b33f-8d89-4333-8921-722aba13278b,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e8b33f-8d') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:25:90,bridge_name='br-int',has_traffic_filtering=True,id=a2e8b33f-8d89-4333-8921-722aba13278b,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e8b33f-8d') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2e8b33f-8d, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2e8b33f-8d, col_values=(('external_ids', {'iface-id': 'a2e8b33f-8d89-4333-8921-722aba13278b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:25:90', 'vm-uuid': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: INFO os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:25:90,bridge_name='br-int',has_traffic_filtering=True,id=a2e8b33f-8d89-4333-8921-722aba13278b,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e8b33f-8d')
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=18d9c10b-cff8-4cc5-9301-78d0d5a1dba7,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d9c10b-cf') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=18d9c10b-cff8-4cc5-9301-78d0d5a1dba7,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d9c10b-cf') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18d9c10b-cf, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18d9c10b-cf, col_values=(('external_ids', {'iface-id': '18d9c10b-cff8-4cc5-9301-78d0d5a1dba7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:7f:09', 'vm-uuid': 'ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: INFO os_vif [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=18d9c10b-cff8-4cc5-9301-78d0d5a1dba7,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d9c10b-cf')
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] No BDM found with device name hda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] No VIF found with MAC fa:16:3e:84:66:67, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] No VIF found with MAC fa:16:3e:1d:bb:b1, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:25:19 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Using config drive
Apr 17 15:25:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.network.neutron [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:25:19 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:25:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:25:20 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Creating config drive at /opt/stack/data/nova/instances/ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d/disk.config
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc9ttzig7 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc9ttzig7" returned: 0 in 0.062s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:25:20 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Creating image(s)
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "/opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "/opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG nova.policy [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c993ceeb4a5c49eea14057e2125518ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b97ff6ed6047f0a33e74684a1c162b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.161s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk 1073741824" returned: 0 in 0.052s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Cannot resize image /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG nova.objects.instance [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lazy-loading 'migration_context' on Instance uuid ddc8a602-70e9-4697-b75b-c602ad4c2447 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Ensure instance console log exists: /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG nova.network.neutron [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Successfully created port: 80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG nova.compute.manager [req-8f3d811d-18a3-4878-88ac-56d045411873 req-ca1c868c-f33b-4954-9160-58b7aea30690 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f3d811d-18a3-4878-88ac-56d045411873 req-ca1c868c-f33b-4954-9160-58b7aea30690 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f3d811d-18a3-4878-88ac-56d045411873 req-ca1c868c-f33b-4954-9160-58b7aea30690 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f3d811d-18a3-4878-88ac-56d045411873 req-ca1c868c-f33b-4954-9160-58b7aea30690 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG nova.compute.manager [req-8f3d811d-18a3-4878-88ac-56d045411873 req-ca1c868c-f33b-4954-9160-58b7aea30690 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:22 user nova-compute[82617]: WARNING nova.compute.manager [req-8f3d811d-18a3-4878-88ac-56d045411873 req-ca1c868c-f33b-4954-9160-58b7aea30690 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 for instance with vm_state building and task_state spawning.
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG nova.compute.manager [req-b751bffe-3765-4fcc-8545-97331a957e0b req-1fd2464e-1ceb-4955-93b5-2f9d3be27e0b service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b751bffe-3765-4fcc-8545-97331a957e0b req-1fd2464e-1ceb-4955-93b5-2f9d3be27e0b service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b751bffe-3765-4fcc-8545-97331a957e0b req-1fd2464e-1ceb-4955-93b5-2f9d3be27e0b service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b751bffe-3765-4fcc-8545-97331a957e0b req-1fd2464e-1ceb-4955-93b5-2f9d3be27e0b service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG nova.compute.manager [req-b751bffe-3765-4fcc-8545-97331a957e0b req-1fd2464e-1ceb-4955-93b5-2f9d3be27e0b service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:22 user nova-compute[82617]: WARNING nova.compute.manager [req-b751bffe-3765-4fcc-8545-97331a957e0b req-1fd2464e-1ceb-4955-93b5-2f9d3be27e0b service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 for instance with vm_state building and task_state spawning.
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-65675fb5-72ec-435f-a855-aeca930acaf7 req-1ec62638-7b1b-4683-a64d-cc1e37f5f54a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-65675fb5-72ec-435f-a855-aeca930acaf7 req-1ec62638-7b1b-4683-a64d-cc1e37f5f54a service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-65675fb5-72ec-435f-a855-aeca930acaf7 req-1ec62638-7b1b-4683-a64d-cc1e37f5f54a service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-65675fb5-72ec-435f-a855-aeca930acaf7 req-1ec62638-7b1b-4683-a64d-cc1e37f5f54a service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-65675fb5-72ec-435f-a855-aeca930acaf7 req-1ec62638-7b1b-4683-a64d-cc1e37f5f54a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:23 user nova-compute[82617]: WARNING nova.compute.manager [req-65675fb5-72ec-435f-a855-aeca930acaf7 req-1ec62638-7b1b-4683-a64d-cc1e37f5f54a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 for instance with vm_state building and task_state spawning.
Apr 17 15:25:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:24 user nova-compute[82617]: WARNING nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 for instance with vm_state building and task_state spawning.
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:24 user nova-compute[82617]: WARNING nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d for instance with vm_state building and task_state spawning.
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:24 user nova-compute[82617]: WARNING nova.compute.manager [req-54325b90-56cc-4e11-aeea-645f0759a446 req-b63ea856-484b-41a5-bbb8-88692186ae12 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d for instance with vm_state building and task_state spawning.
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.network.neutron [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Successfully updated port: 80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "refresh_cache-ddc8a602-70e9-4697-b75b-c602ad4c2447" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquired lock "refresh_cache-ddc8a602-70e9-4697-b75b-c602ad4c2447" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.network.neutron [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:24 user nova-compute[82617]: WARNING nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 for instance with vm_state building and task_state spawning.
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:24 user nova-compute[82617]: WARNING nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b for instance with vm_state building and task_state spawning.
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:24 user nova-compute[82617]: WARNING nova.compute.manager [req-422c4e12-8d6a-4114-b715-b9fb362f29b5 req-8fe742fe-d237-4b6a-b4e9-036874181c36 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b for instance with vm_state building and task_state spawning.
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG nova.network.neutron [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.network.neutron [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Updating instance_info_cache with network_info: [{"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Releasing lock "refresh_cache-ddc8a602-70e9-4697-b75b-c602ad4c2447" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Instance network_info: |[{"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Start _get_guest_xml network_info=[{"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:25:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-513092781',display_name='tempest-VolumesActionsTest-instance-513092781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-513092781',id=10,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b97ff6ed6047f0a33e74684a1c162b',ramdisk_id='',reservation_id='r-3gw1j5r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-707453245',owner_user_name='tempest-VolumesActionsTest-707453245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:25:20Z,user_data=None,user_id='c993ceeb4a5c49eea14057e2125518ad',uuid=ddc8a602-70e9-4697-b75b-c602ad4c2447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Converting VIF {"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=80be52be-1998-4d71-b2d6-598239b3c2a7,network=Network(28b8c668-d290-4e32-b2e2-7df0a657f4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80be52be-19') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.objects.instance [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lazy-loading 'pci_devices' on Instance uuid ddc8a602-70e9-4697-b75b-c602ad4c2447 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:25:25 user nova-compute[82617]:   <uuid>ddc8a602-70e9-4697-b75b-c602ad4c2447</uuid>
Apr 17 15:25:25 user nova-compute[82617]:   <name>instance-0000000a</name>
Apr 17 15:25:25 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:25:25 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:25:25 user nova-compute[82617]:   <metadata>
Apr 17 15:25:25 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:25:25 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:25:25 user nova-compute[82617]:       <nova:name>tempest-VolumesActionsTest-instance-513092781</nova:name>
Apr 17 15:25:25 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:25:25</nova:creationTime>
Apr 17 15:25:25 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:25:25 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:25:25 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:25:25 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:25:25 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:25:25 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:25:25 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:25:25 user nova-compute[82617]:       <nova:owner>
Apr 17 15:25:25 user nova-compute[82617]:         <nova:user uuid="c993ceeb4a5c49eea14057e2125518ad">tempest-VolumesActionsTest-707453245-project-member</nova:user>
Apr 17 15:25:25 user nova-compute[82617]:         <nova:project uuid="a8b97ff6ed6047f0a33e74684a1c162b">tempest-VolumesActionsTest-707453245</nova:project>
Apr 17 15:25:25 user nova-compute[82617]:       </nova:owner>
Apr 17 15:25:25 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:25:25 user nova-compute[82617]:       <nova:ports>
Apr 17 15:25:25 user nova-compute[82617]:         <nova:port uuid="80be52be-1998-4d71-b2d6-598239b3c2a7">
Apr 17 15:25:25 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 15:25:25 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:25 user nova-compute[82617]:       </nova:ports>
Apr 17 15:25:25 user nova-compute[82617]:     </nova:instance>
Apr 17 15:25:25 user nova-compute[82617]:   </metadata>
Apr 17 15:25:25 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:25:25 user nova-compute[82617]:     <system>
Apr 17 15:25:25 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:25:25 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:25:25 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:25:25 user nova-compute[82617]:       <entry name="serial">ddc8a602-70e9-4697-b75b-c602ad4c2447</entry>
Apr 17 15:25:25 user nova-compute[82617]:       <entry name="uuid">ddc8a602-70e9-4697-b75b-c602ad4c2447</entry>
Apr 17 15:25:25 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:25:25 user nova-compute[82617]:     </system>
Apr 17 15:25:25 user nova-compute[82617]:   </sysinfo>
Apr 17 15:25:25 user nova-compute[82617]:   <os>
Apr 17 15:25:25 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:25:25 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:25:25 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:25:25 user nova-compute[82617]:   </os>
Apr 17 15:25:25 user nova-compute[82617]:   <features>
Apr 17 15:25:25 user nova-compute[82617]:     <acpi/>
Apr 17 15:25:25 user nova-compute[82617]:     <apic/>
Apr 17 15:25:25 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:25:25 user nova-compute[82617]:   </features>
Apr 17 15:25:25 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:25:25 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:25:25 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:25:25 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:25:25 user nova-compute[82617]:   </clock>
Apr 17 15:25:25 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:25:25 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:25:25 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:25:25 user nova-compute[82617]:   </cpu>
Apr 17 15:25:25 user nova-compute[82617]:   <devices>
Apr 17 15:25:25 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:25:25 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:25:25 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk"/>
Apr 17 15:25:25 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:25:25 user nova-compute[82617]:     </disk>
Apr 17 15:25:25 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:25 user nova-compute[82617]:       <mac address="fa:16:3e:a8:37:3e"/>
Apr 17 15:25:25 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:25 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:25 user nova-compute[82617]:       <target dev="tap80be52be-19"/>
Apr 17 15:25:25 user nova-compute[82617]:     </interface>
Apr 17 15:25:25 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:25:25 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/console.log" append="off"/>
Apr 17 15:25:25 user nova-compute[82617]:     </serial>
Apr 17 15:25:25 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:25:25 user nova-compute[82617]:     <video>
Apr 17 15:25:25 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:25 user nova-compute[82617]:     </video>
Apr 17 15:25:25 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:25:25 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:25:25 user nova-compute[82617]:     </rng>
Apr 17 15:25:25 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:25:25 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:25:25 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:25:25 user nova-compute[82617]:     </memballoon>
Apr 17 15:25:25 user nova-compute[82617]:   </devices>
Apr 17 15:25:25 user nova-compute[82617]: </domain>
Apr 17 15:25:25 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-513092781',display_name='tempest-VolumesActionsTest-instance-513092781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-513092781',id=10,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8b97ff6ed6047f0a33e74684a1c162b',ramdisk_id='',reservation_id='r-3gw1j5r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-707453245',owner_user_name='tempest-VolumesActionsTest-707453245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:25:20Z,user_data=None,user_id='c993ceeb4a5c49eea14057e2125518ad',uuid=ddc8a602-70e9-4697-b75b-c602ad4c2447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Converting VIF {"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=80be52be-1998-4d71-b2d6-598239b3c2a7,network=Network(28b8c668-d290-4e32-b2e2-7df0a657f4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80be52be-19') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG os_vif [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=80be52be-1998-4d71-b2d6-598239b3c2a7,network=Network(28b8c668-d290-4e32-b2e2-7df0a657f4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80be52be-19') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80be52be-19, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80be52be-19, col_values=(('external_ids', {'iface-id': '80be52be-1998-4d71-b2d6-598239b3c2a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:37:3e', 'vm-uuid': 'ddc8a602-70e9-4697-b75b-c602ad4c2447'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:25 user nova-compute[82617]: INFO os_vif [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=80be52be-1998-4d71-b2d6-598239b3c2a7,network=Network(28b8c668-d290-4e32-b2e2-7df0a657f4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80be52be-19')
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:25 user nova-compute[82617]: WARNING nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 for instance with vm_state building and task_state spawning.
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received event network-changed-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Refreshing instance network info cache due to event network-changed-80be52be-1998-4d71-b2d6-598239b3c2a7. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Acquiring lock "refresh_cache-ddc8a602-70e9-4697-b75b-c602ad4c2447" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Acquired lock "refresh_cache-ddc8a602-70e9-4697-b75b-c602ad4c2447" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.network.neutron [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Refreshing network info cache for port 80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] No VIF found with MAC fa:16:3e:a8:37:3e, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745125.8594835, ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:25:25 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] VM Resumed (Lifecycle Event)
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:25:25 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance spawned successfully.
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:25:25 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745125.8636842, ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:25:25 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] VM Started (Lifecycle Event)
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:25:26 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:25:26 user nova-compute[82617]: INFO nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Took 10.92 seconds to spawn the instance on the hypervisor.
Apr 17 15:25:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:26 user nova-compute[82617]: INFO nova.compute.manager [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Took 32.60 seconds to build instance.
Apr 17 15:25:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-120c9c51-a7c0-483f-b2de-e5ce22a20a39 tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.710s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG nova.network.neutron [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Updated VIF entry in instance network info cache for port 80be52be-1998-4d71-b2d6-598239b3c2a7. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG nova.network.neutron [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Updating instance_info_cache with network_info: [{"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Releasing lock "refresh_cache-ddc8a602-70e9-4697-b75b-c602ad4c2447" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:26 user nova-compute[82617]: WARNING nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 for instance with vm_state building and task_state spawning.
Apr 17 15:25:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:26 user nova-compute[82617]: WARNING nova.compute.manager [req-27f245c3-12df-468c-a5cb-ef9706c6d931 req-3f7a35cf-e9f7-4a73-b997-79f14df8c2bb service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 for instance with vm_state building and task_state spawning.
Apr 17 15:25:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-63a7e284-4a47-4302-9e65-3624fa7cacf1 req-932277bd-77a3-4fad-bbfa-d68279f8a928 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received event network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-63a7e284-4a47-4302-9e65-3624fa7cacf1 req-932277bd-77a3-4fad-bbfa-d68279f8a928 service nova] Acquiring lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-63a7e284-4a47-4302-9e65-3624fa7cacf1 req-932277bd-77a3-4fad-bbfa-d68279f8a928 service nova] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-63a7e284-4a47-4302-9e65-3624fa7cacf1 req-932277bd-77a3-4fad-bbfa-d68279f8a928 service nova] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-63a7e284-4a47-4302-9e65-3624fa7cacf1 req-932277bd-77a3-4fad-bbfa-d68279f8a928 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] No waiting events found dispatching network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:27 user nova-compute[82617]: WARNING nova.compute.manager [req-63a7e284-4a47-4302-9e65-3624fa7cacf1 req-932277bd-77a3-4fad-bbfa-d68279f8a928 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received unexpected event network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 for instance with vm_state building and task_state spawning.
Apr 17 15:25:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:27 user nova-compute[82617]: WARNING nova.compute.manager [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 for instance with vm_state active and task_state None.
Apr 17 15:25:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:27 user nova-compute[82617]: WARNING nova.compute.manager [req-e4d21a9f-0779-497c-80e1-b11f1658292a req-66402785-7ffb-42ef-aa0a-0206d009f8ec service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 for instance with vm_state active and task_state None.
Apr 17 15:25:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745129.384783, ddc8a602-70e9-4697-b75b-c602ad4c2447 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:25:29 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] VM Resumed (Lifecycle Event)
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:25:29 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Instance spawned successfully.
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:25:29 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745129.3886898, ddc8a602-70e9-4697-b75b-c602ad4c2447 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:25:29 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] VM Started (Lifecycle Event)
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:25:29 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:25:29 user nova-compute[82617]: INFO nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Took 9.41 seconds to spawn the instance on the hypervisor.
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd27fef7-286d-42ee-9805-d102f3ecddce req-e3a8d225-f7cc-4f60-a0df-498c9f69f804 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received event network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd27fef7-286d-42ee-9805-d102f3ecddce req-e3a8d225-f7cc-4f60-a0df-498c9f69f804 service nova] Acquiring lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd27fef7-286d-42ee-9805-d102f3ecddce req-e3a8d225-f7cc-4f60-a0df-498c9f69f804 service nova] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd27fef7-286d-42ee-9805-d102f3ecddce req-e3a8d225-f7cc-4f60-a0df-498c9f69f804 service nova] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd27fef7-286d-42ee-9805-d102f3ecddce req-e3a8d225-f7cc-4f60-a0df-498c9f69f804 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] No waiting events found dispatching network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:29 user nova-compute[82617]: WARNING nova.compute.manager [req-bd27fef7-286d-42ee-9805-d102f3ecddce req-e3a8d225-f7cc-4f60-a0df-498c9f69f804 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received unexpected event network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 for instance with vm_state building and task_state spawning.
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:29 user nova-compute[82617]: INFO nova.compute.manager [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Took 10.40 seconds to build instance.
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47ec2167-d122-420a-83d3-9fd7f3aead84 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.532s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:25:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:25:30 user nova-compute[82617]: INFO nova.compute.claims [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Claim successful on node user
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:25:30 user nova-compute[82617]: DEBUG nova.network.neutron [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:25:30 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:25:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:25:31 user nova-compute[82617]: INFO nova.virt.block_device [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Booting with volume d895d11d-6880-4418-a9ad-feca813ed5d6 at /dev/vda
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG nova.policy [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '909c09f2587f42f895352916d3f8636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df343eb0d64207a5f9f91aa0810999', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG os_brick.utils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4de969-2905-4948-af2a-0c6667ae1f12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3847d-cf30-4123-9981-8dfa83508ff6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fda7d8-c961-4fde-a0e4-3767820f960c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[7228c33b-7b9b-4bcf-86ee-b4677897d691]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:25:31 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dd64c2-1935-4f42-b319-6a1ca713d88a]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG os_brick.utils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updating existing volume attachment record: c0eb6e83-df81-4c2b-920c-8280d74fcde6 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG nova.network.neutron [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Successfully created port: 8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.network.neutron [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Successfully updated port: 8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-f63d1790-4896-426e-8279-c07ab7d82ede req-a0f71f16-d94b-4d54-ada0-db145581d819 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received event network-changed-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-f63d1790-4896-426e-8279-c07ab7d82ede req-a0f71f16-d94b-4d54-ada0-db145581d819 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Refreshing instance network info cache due to event network-changed-8dbf801a-36a8-4443-9367-e795d4689bbc. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f63d1790-4896-426e-8279-c07ab7d82ede req-a0f71f16-d94b-4d54-ada0-db145581d819 service nova] Acquiring lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f63d1790-4896-426e-8279-c07ab7d82ede req-a0f71f16-d94b-4d54-ada0-db145581d819 service nova] Acquired lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.network.neutron [req-f63d1790-4896-426e-8279-c07ab7d82ede req-a0f71f16-d94b-4d54-ada0-db145581d819 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Refreshing network info cache for port 8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:25:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=26.57577896118164GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.network.neutron [req-f63d1790-4896-426e-8279-c07ab7d82ede req-a0f71f16-d94b-4d54-ada0-db145581d819 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 70667df1-34e8-4063-a2fc-1fc7d63318f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 109c9a23-751e-4b29-abcf-0f003adb35cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance ddc8a602-70e9-4697-b75b-c602ad4c2447 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.network.neutron [req-f63d1790-4896-426e-8279-c07ab7d82ede req-a0f71f16-d94b-4d54-ada0-db145581d819 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f63d1790-4896-426e-8279-c07ab7d82ede req-a0f71f16-d94b-4d54-ada0-db145581d819 service nova] Releasing lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquired lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.network.neutron [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.network.neutron [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:25:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:34 user nova-compute[82617]: DEBUG nova.network.neutron [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updating instance_info_cache with network_info: [{"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Releasing lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Instance network_info: |[{"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:25:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:35 user nova-compute[82617]: DEBUG nova.objects.instance [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lazy-loading 'flavor' on Instance uuid 70667df1-34e8-4063-a2fc-1fc7d63318f9 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:36 user nova-compute[82617]: INFO nova.compute.manager [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Attaching volume a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 to /dev/vdb
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.utils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dbacfb-a50a-41c1-8641-f39d2f19acb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba60df0-9d5b-479b-8d07-9f427a53b064]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b98cdb-6963-41c4-b4be-bcd673a58b93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b1e62-bfc8-481f-84fd-4a5801f4272d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:25:36 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[67654e51-3646-403b-a5a2-ccbd04bbb5d4]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.utils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Updating existing volume attachment record: 48883706-c9f1-4af4-93c4-d1fe08ad33fa {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:25:36 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Creating image(s)
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Did not create local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Ensure instance console log exists: /opt/stack/data/nova/instances/edb2d74c-f1e0-4954-9ba9-812fc12562a7/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Start _get_guest_xml network_info=[{"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVRqMWdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edb2d74c-f1e0-4954-9ba9-812fc12562a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd895d11d-6880-4418-a9ad-feca813ed5d6', 'serial': 'd895d11d-6880-4418-a9ad-feca813ed5d6'}, 'device_type': 'disk', 'attachment_id': 'c0eb6e83-df81-4c2b-920c-8280d74fcde6', 'volume_type': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:25:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:25:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVRqMWdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:36 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:36 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:36 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[45982867-569f-4abf-afd1-67a59d7815f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:25:36 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca528a4-109b-4bd4-8d4a-2d3fae51d00c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6] added
Apr 17 15:25:36 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3d6e4-a7e8-49a6-b8a6-7059ac2b3e41]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[429e33ac-32c9-4b4a-b5df-eae7ba48a9a1]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVRqMWdJ {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVRqMWdJ" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[dace35bc-393f-408f-94b8-63c19ecb8087]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FVRqMWdJ'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[573b5acb-5799-4bf7-b73f-f116dd3d9d30]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd33cca-b953-45d4-a344-c52c1d2bc191]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:36 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:36 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a517529-703d-414c-a19b-1641baf5c26a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6, portal: 172.16.0.220,3260]
Apr 17 15:25:36 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6, portal: 172.16.0.220,3260] successful.
Apr 17 15:25:36 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5070a32f-4151-4a40-8650-3c2f347328b2]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c5b3b0-d45a-44c8-aeeb-8ae5558dc521]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:25:36 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:36 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:25:36 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd135ac-02af-438d-a230-1f4787ebfd33]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:25:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVRqMWdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:25:37 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:37 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23163316263666338', 'path': '/dev/sde'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163316263666338', 'path': '/dev/sde'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:25:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:25:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2065924545',display_name='tempest-TestShelveInstance-server-2065924545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2065924545',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsDBXTpDwPUDZ3qwrjtkm/FJOXPmfagxCn+shNEPRPuwp+1B/JL0NwZS4lJfZsYclOhazIWS4EKbhzG0tIbl8IxrZY7Rql2V8DiRFQqkdSjnVif0EwcrAoIjo8dMGt1A==',key_name='tempest-TestShelveInstance-1958416844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2df343eb0d64207a5f9f91aa0810999',ramdisk_id='',reservation_id='r-ddwuh0uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1683612675',owner_user_name='tempest-TestShelveInstance-1683612675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:25:31Z,user_data=None,user_id='909c09f2587f42f895352916d3f8636a',uuid=edb2d74c-f1e0-4954-9ba9-812fc12562a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:25:37 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Converting VIF {"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:37 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e1:47,bridge_name='br-int',has_traffic_filtering=True,id=8dbf801a-36a8-4443-9367-e795d4689bbc,network=Network(91c16f73-094f-4b02-83d2-468d885641ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dbf801a-36') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:37 user nova-compute[82617]: DEBUG nova.objects.instance [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lazy-loading 'pci_devices' on Instance uuid edb2d74c-f1e0-4954-9ba9-812fc12562a7 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:25:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:25:37 user nova-compute[82617]:   <uuid>edb2d74c-f1e0-4954-9ba9-812fc12562a7</uuid>
Apr 17 15:25:37 user nova-compute[82617]:   <name>instance-0000000b</name>
Apr 17 15:25:37 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:25:37 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:25:37 user nova-compute[82617]:   <metadata>
Apr 17 15:25:37 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:25:37 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:25:37 user nova-compute[82617]:       <nova:name>tempest-TestShelveInstance-server-2065924545</nova:name>
Apr 17 15:25:37 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:25:36</nova:creationTime>
Apr 17 15:25:37 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:25:37 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:25:37 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:25:37 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:25:37 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:25:37 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:25:37 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:25:37 user nova-compute[82617]:       <nova:owner>
Apr 17 15:25:37 user nova-compute[82617]:         <nova:user uuid="909c09f2587f42f895352916d3f8636a">tempest-TestShelveInstance-1683612675-project-member</nova:user>
Apr 17 15:25:37 user nova-compute[82617]:         <nova:project uuid="a2df343eb0d64207a5f9f91aa0810999">tempest-TestShelveInstance-1683612675</nova:project>
Apr 17 15:25:37 user nova-compute[82617]:       </nova:owner>
Apr 17 15:25:37 user nova-compute[82617]:       <nova:ports>
Apr 17 15:25:37 user nova-compute[82617]:         <nova:port uuid="8dbf801a-36a8-4443-9367-e795d4689bbc">
Apr 17 15:25:37 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 17 15:25:37 user nova-compute[82617]:         </nova:port>
Apr 17 15:25:37 user nova-compute[82617]:       </nova:ports>
Apr 17 15:25:37 user nova-compute[82617]:     </nova:instance>
Apr 17 15:25:37 user nova-compute[82617]:   </metadata>
Apr 17 15:25:37 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:25:37 user nova-compute[82617]:     <system>
Apr 17 15:25:37 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:25:37 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:25:37 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:25:37 user nova-compute[82617]:       <entry name="serial">edb2d74c-f1e0-4954-9ba9-812fc12562a7</entry>
Apr 17 15:25:37 user nova-compute[82617]:       <entry name="uuid">edb2d74c-f1e0-4954-9ba9-812fc12562a7</entry>
Apr 17 15:25:37 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:25:37 user nova-compute[82617]:     </system>
Apr 17 15:25:37 user nova-compute[82617]:   </sysinfo>
Apr 17 15:25:37 user nova-compute[82617]:   <os>
Apr 17 15:25:37 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:25:37 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:25:37 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:25:37 user nova-compute[82617]:   </os>
Apr 17 15:25:37 user nova-compute[82617]:   <features>
Apr 17 15:25:37 user nova-compute[82617]:     <acpi/>
Apr 17 15:25:37 user nova-compute[82617]:     <apic/>
Apr 17 15:25:37 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:25:37 user nova-compute[82617]:   </features>
Apr 17 15:25:37 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:25:37 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:25:37 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:25:37 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:25:37 user nova-compute[82617]:   </clock>
Apr 17 15:25:37 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:25:37 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:25:37 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:25:37 user nova-compute[82617]:   </cpu>
Apr 17 15:25:37 user nova-compute[82617]:   <devices>
Apr 17 15:25:37 user nova-compute[82617]:     <disk type="block" device="disk">
Apr 17 15:25:37 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:25:37 user nova-compute[82617]:       <source dev="/dev/sde"/>
Apr 17 15:25:37 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:25:37 user nova-compute[82617]:       <serial>d895d11d-6880-4418-a9ad-feca813ed5d6</serial>
Apr 17 15:25:37 user nova-compute[82617]:     </disk>
Apr 17 15:25:37 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:25:37 user nova-compute[82617]:       <mac address="fa:16:3e:d9:e1:47"/>
Apr 17 15:25:37 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:37 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:25:37 user nova-compute[82617]:       <target dev="tap8dbf801a-36"/>
Apr 17 15:25:37 user nova-compute[82617]:     </interface>
Apr 17 15:25:37 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:25:37 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/edb2d74c-f1e0-4954-9ba9-812fc12562a7/console.log" append="off"/>
Apr 17 15:25:37 user nova-compute[82617]:     </serial>
Apr 17 15:25:37 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:25:37 user nova-compute[82617]:     <video>
Apr 17 15:25:37 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:25:37 user nova-compute[82617]:     </video>
Apr 17 15:25:37 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:25:37 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:25:37 user nova-compute[82617]:     </rng>
Apr 17 15:25:37 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:25:37 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:25:37 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:25:37 user nova-compute[82617]:     </memballoon>
Apr 17 15:25:37 user nova-compute[82617]:   </devices>
Apr 17 15:25:37 user nova-compute[82617]: </domain>
Apr 17 15:25:37 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:25:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2065924545',display_name='tempest-TestShelveInstance-server-2065924545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2065924545',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsDBXTpDwPUDZ3qwrjtkm/FJOXPmfagxCn+shNEPRPuwp+1B/JL0NwZS4lJfZsYclOhazIWS4EKbhzG0tIbl8IxrZY7Rql2V8DiRFQqkdSjnVif0EwcrAoIjo8dMGt1A==',key_name='tempest-TestShelveInstance-1958416844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2df343eb0d64207a5f9f91aa0810999',ramdisk_id='',reservation_id='r-ddwuh0uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1683612675',owner_user_name='tempest-TestShelveInstance-1683612675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:25:31Z,user_data=None,user_id='909c09f2587f42f895352916d3f8636a',uuid=edb2d74c-f1e0-4954-9ba9-812fc12562a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Converting VIF {"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e1:47,bridge_name='br-int',has_traffic_filtering=True,id=8dbf801a-36a8-4443-9367-e795d4689bbc,network=Network(91c16f73-094f-4b02-83d2-468d885641ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dbf801a-36') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG os_vif [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e1:47,bridge_name='br-int',has_traffic_filtering=True,id=8dbf801a-36a8-4443-9367-e795d4689bbc,network=Network(91c16f73-094f-4b02-83d2-468d885641ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dbf801a-36') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8dbf801a-36, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8dbf801a-36, col_values=(('external_ids', {'iface-id': '8dbf801a-36a8-4443-9367-e795d4689bbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:e1:47', 'vm-uuid': 'edb2d74c-f1e0-4954-9ba9-812fc12562a7'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:38 user nova-compute[82617]: INFO os_vif [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e1:47,bridge_name='br-int',has_traffic_filtering=True,id=8dbf801a-36a8-4443-9367-e795d4689bbc,network=Network(91c16f73-094f-4b02-83d2-468d885641ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dbf801a-36')
Apr 17 15:25:38 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:25:38 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] No VIF found with MAC fa:16:3e:d9:e1:47, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG nova.compute.manager [req-922a4af2-fd37-4470-b5cc-33bb7daf4520 req-659eb9e0-b915-4cfe-806c-da47bae154de service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received event network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-922a4af2-fd37-4470-b5cc-33bb7daf4520 req-659eb9e0-b915-4cfe-806c-da47bae154de service nova] Acquiring lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-922a4af2-fd37-4470-b5cc-33bb7daf4520 req-659eb9e0-b915-4cfe-806c-da47bae154de service nova] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-922a4af2-fd37-4470-b5cc-33bb7daf4520 req-659eb9e0-b915-4cfe-806c-da47bae154de service nova] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:39 user nova-compute[82617]: DEBUG nova.compute.manager [req-922a4af2-fd37-4470-b5cc-33bb7daf4520 req-659eb9e0-b915-4cfe-806c-da47bae154de service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] No waiting events found dispatching network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:39 user nova-compute[82617]: WARNING nova.compute.manager [req-922a4af2-fd37-4470-b5cc-33bb7daf4520 req-659eb9e0-b915-4cfe-806c-da47bae154de service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received unexpected event network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc for instance with vm_state building and task_state spawning.
Apr 17 15:25:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxEFJebi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:41 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:41 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:41 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38e0f95-38fe-45ce-8279-d8569c4fc042]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:25:41 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf3d80b-e60b-40df-8c3d-26e357fcedb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326] added
Apr 17 15:25:41 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4df810b-cfb3-4f33-93e0-e1c936aecbdb]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba26a44-3e40-421c-984a-075256f4e2fd]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rxEFJebi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rxEFJebi" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c41bb07-6d04-4124-af2b-572f4131b097]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rxEFJebi'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3884722-599e-4a63-aee2-d623d057ebd6]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0428d90-48f2-4151-b550-a2c5e8142104]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.compute.manager [req-c08a1eb0-614b-4df2-9a21-30afeade02ba req-821a172a-9b9f-4202-a3ba-95d9a0b09ce6 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received event network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c08a1eb0-614b-4df2-9a21-30afeade02ba req-821a172a-9b9f-4202-a3ba-95d9a0b09ce6 service nova] Acquiring lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c08a1eb0-614b-4df2-9a21-30afeade02ba req-821a172a-9b9f-4202-a3ba-95d9a0b09ce6 service nova] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c08a1eb0-614b-4df2-9a21-30afeade02ba req-821a172a-9b9f-4202-a3ba-95d9a0b09ce6 service nova] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.compute.manager [req-c08a1eb0-614b-4df2-9a21-30afeade02ba req-821a172a-9b9f-4202-a3ba-95d9a0b09ce6 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] No waiting events found dispatching network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:41 user nova-compute[82617]: WARNING nova.compute.manager [req-c08a1eb0-614b-4df2-9a21-30afeade02ba req-821a172a-9b9f-4202-a3ba-95d9a0b09ce6 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received unexpected event network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc for instance with vm_state building and task_state spawning.
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745141.7120705, edb2d74c-f1e0-4954-9ba9-812fc12562a7 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:25:41 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] VM Resumed (Lifecycle Event)
Apr 17 15:25:41 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Instance spawned successfully.
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[15afa00f-b04e-47a1-9f41-a1929c38c8f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326, portal: 172.16.0.220,3260]
Apr 17 15:25:41 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326, portal: 172.16.0.220,3260] successful.
Apr 17 15:25:41 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:25:41 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745141.7133653, edb2d74c-f1e0-4954-9ba9-812fc12562a7 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:25:41 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] VM Started (Lifecycle Event)
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5556c5d2-473b-4f95-b768-6dfbd02d21e3]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa15a66a-f16c-40eb-919c-03718fb0a6d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 (non-flash)
Apr 17 15:25:41 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:41 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:25:41 user nova-compute[82617]: INFO nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 17 15:25:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c328a3-1968-4df5-9e26-e8ac9ef907f0]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:25:41 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxEFJebi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:25:41 user nova-compute[82617]: INFO nova.compute.manager [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Took 11.77 seconds to build instance.
Apr 17 15:25:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e68739af-adba-4118-be06-d8d33ae11364 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.944s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23966613166316366', 'path': '/dev/sdf'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966613166316366', 'path': '/dev/sdf'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:25:42 user nova-compute[82617]: DEBUG nova.objects.instance [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lazy-loading 'flavor' on Instance uuid 70667df1-34e8-4063-a2fc-1fc7d63318f9 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:25:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 15:25:42 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:25:42 user nova-compute[82617]:   <source dev="/dev/sdf"/>
Apr 17 15:25:42 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:25:42 user nova-compute[82617]:   <serial>a5f9d059-9f1b-4cf5-ae89-92bcf6c50326</serial>
Apr 17 15:25:42 user nova-compute[82617]: </disk>
Apr 17 15:25:42 user nova-compute[82617]:  {{(pid=82617) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 15:25:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:43 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:25:43 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:25:43 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] No VIF found with MAC fa:16:3e:ea:1e:1d, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:25:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-664238cc-8c86-4ea1-a1cc-92af4eab666f tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.264s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:44 user nova-compute[82617]: INFO nova.compute.manager [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Terminating instance
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.compute.manager [req-a1c83cba-15ae-4d2e-8034-c36b2c498da1 req-c19837d4-69d5-494b-86b3-3dc27b0822e3 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received event network-vif-unplugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a1c83cba-15ae-4d2e-8034-c36b2c498da1 req-c19837d4-69d5-494b-86b3-3dc27b0822e3 service nova] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a1c83cba-15ae-4d2e-8034-c36b2c498da1 req-c19837d4-69d5-494b-86b3-3dc27b0822e3 service nova] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a1c83cba-15ae-4d2e-8034-c36b2c498da1 req-c19837d4-69d5-494b-86b3-3dc27b0822e3 service nova] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.compute.manager [req-a1c83cba-15ae-4d2e-8034-c36b2c498da1 req-c19837d4-69d5-494b-86b3-3dc27b0822e3 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] No waiting events found dispatching network-vif-unplugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.compute.manager [req-a1c83cba-15ae-4d2e-8034-c36b2c498da1 req-c19837d4-69d5-494b-86b3-3dc27b0822e3 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received event network-vif-unplugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:44 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Instance destroyed successfully.
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.objects.instance [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lazy-loading 'resources' on Instance uuid 70667df1-34e8-4063-a2fc-1fc7d63318f9 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2114257856',display_name='tempest-DeleteServersTestJSON-server-2114257856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2114257856',id=1,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:23:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8aecd98c92d74f6b9879e6f57125ebde',ramdisk_id='',reservation_id='r-0s4imm0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1458225442',owner_user_name='tempest-DeleteServersTestJSON-1458225442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:23:58Z,user_data=None,user_id='fec7c09a38ee413db724c659acc576ce',uuid=70667df1-34e8-4063-a2fc-1fc7d63318f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Converting VIF {"id": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "address": "fa:16:3e:ea:1e:1d", "network": {"id": "97617f5f-1a5f-4847-bac4-3e6b4fc93222", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1896755839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aecd98c92d74f6b9879e6f57125ebde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5d2e201-0f", "ovs_interfaceid": "d5d2e201-0f95-420c-ab2a-cc475e36d2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:1d,bridge_name='br-int',has_traffic_filtering=True,id=d5d2e201-0f95-420c-ab2a-cc475e36d2f5,network=Network(97617f5f-1a5f-4847-bac4-3e6b4fc93222),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d2e201-0f') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_vif [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:1d,bridge_name='br-int',has_traffic_filtering=True,id=d5d2e201-0f95-420c-ab2a-cc475e36d2f5,network=Network(97617f5f-1a5f-4847-bac4-3e6b4fc93222),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d2e201-0f') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5d2e201-0f, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:25:44 user nova-compute[82617]: INFO os_vif [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:1d,bridge_name='br-int',has_traffic_filtering=True,id=d5d2e201-0f95-420c-ab2a-cc475e36d2f5,network=Network(97617f5f-1a5f-4847-bac4-3e6b4fc93222),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5d2e201-0f')
Apr 17 15:25:44 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxEFJebi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:25:44 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d94cda-9440-4b79-8a3b-64de4f46e21f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:25:44 user nova-compute[82617]: No targets found.
Apr 17 15:25:44 user nova-compute[82617]: iSNS:
Apr 17 15:25:44 user nova-compute[82617]: No targets found.
Apr 17 15:25:44 user nova-compute[82617]: STATIC:
Apr 17 15:25:44 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310
Apr 17 15:25:44 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:25:44 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:25:44 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326
Apr 17 15:25:44 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:25:44 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:25:44 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f
Apr 17 15:25:44 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:25:44 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:25:44 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:25:44 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:25:44 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:25:44 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c
Apr 17 15:25:44 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:25:44 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:25:44 user nova-compute[82617]: FIRMWARE:
Apr 17 15:25:44 user nova-compute[82617]: No targets found.
Apr 17 15:25:44 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:25:44 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:25:44 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa27651-16ed-4869-b708-f8c62baab41c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20ba5d4-629a-40c6-be56-9f3a631fd9e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:44 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:44 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:44 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:25:44 user nova-compute[82617]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 (non-flash)
Apr 17 15:25:44 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:25:44 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:25:44 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:25:44 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:25:44 user nova-compute[82617]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 (non-flash)
Apr 17 15:25:44 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6482c1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326'): ({'sdf'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Removing single pathed devices sdf {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:25:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[171ddfb5-74ad-4ac8-92d5-082b2c9ccfb2]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a548af4f-5366-4c1e-8ca2-be4251f41dba]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Flushing IO for device /dev/sdf {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bb42a2-1186-4dc9-aaa8-6b75986ef4c5]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d759e-92ad-40b4-ba2f-35db1b2095bd]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] SCSI volumes sdf have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4cc9b2-4ce7-4a6c-aa8e-cdda4a9786ea]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dacdc66-146e-411b-a94f-4f5937936a2f]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326, portal: 172.16.0.220,3260]
Apr 17 15:25:45 user nova-compute[82617]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326, portal: 172.16.0.220,3260] successful.
Apr 17 15:25:45 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9d059-9f1b-4cf5-ae89-92bcf6c50326 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[559444a1-5859-4564-a46c-203a323e17b9]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] <== disconnect_volume: return (307ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:25:45 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Deleting instance files /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9_del
Apr 17 15:25:45 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Deletion of /opt/stack/data/nova/instances/70667df1-34e8-4063-a2fc-1fc7d63318f9_del complete
Apr 17 15:25:45 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Checking UEFI support for host arch (x86_64) {{(pid=82617) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 17 15:25:45 user nova-compute[82617]: INFO nova.virt.libvirt.host [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] UEFI support detected
Apr 17 15:25:45 user nova-compute[82617]: INFO nova.compute.manager [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 17 15:25:45 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:25:45 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:25:46 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:46 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Took 0.90 seconds to deallocate network for instance.
Apr 17 15:25:46 user nova-compute[82617]: DEBUG nova.compute.manager [req-71e07cb6-4c5f-4b18-ac4d-2782498037ed req-83a87c15-b725-47c2-9d34-e0ec02457139 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received event network-vif-deleted-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:46 user nova-compute[82617]: INFO nova.compute.manager [req-71e07cb6-4c5f-4b18-ac4d-2782498037ed req-83a87c15-b725-47c2-9d34-e0ec02457139 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Neutron deleted interface d5d2e201-0f95-420c-ab2a-cc475e36d2f5; detaching it from the instance and deleting it from the info cache
Apr 17 15:25:46 user nova-compute[82617]: DEBUG nova.network.neutron [req-71e07cb6-4c5f-4b18-ac4d-2782498037ed req-83a87c15-b725-47c2-9d34-e0ec02457139 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:46 user nova-compute[82617]: DEBUG nova.compute.manager [req-71e07cb6-4c5f-4b18-ac4d-2782498037ed req-83a87c15-b725-47c2-9d34-e0ec02457139 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Detach interface failed, port_id=d5d2e201-0f95-420c-ab2a-cc475e36d2f5, reason: Instance 70667df1-34e8-4063-a2fc-1fc7d63318f9 could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:25:46 user nova-compute[82617]: DEBUG nova.compute.manager [req-ec25bbb7-bdc7-4507-aad1-17064adbdab2 req-4a561976-03df-4886-a4f0-11015ff98ea8 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received event network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ec25bbb7-bdc7-4507-aad1-17064adbdab2 req-4a561976-03df-4886-a4f0-11015ff98ea8 service nova] Acquiring lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ec25bbb7-bdc7-4507-aad1-17064adbdab2 req-4a561976-03df-4886-a4f0-11015ff98ea8 service nova] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ec25bbb7-bdc7-4507-aad1-17064adbdab2 req-4a561976-03df-4886-a4f0-11015ff98ea8 service nova] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:46 user nova-compute[82617]: DEBUG nova.compute.manager [req-ec25bbb7-bdc7-4507-aad1-17064adbdab2 req-4a561976-03df-4886-a4f0-11015ff98ea8 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] No waiting events found dispatching network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:46 user nova-compute[82617]: WARNING nova.compute.manager [req-ec25bbb7-bdc7-4507-aad1-17064adbdab2 req-4a561976-03df-4886-a4f0-11015ff98ea8 service nova] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Received unexpected event network-vif-plugged-d5d2e201-0f95-420c-ab2a-cc475e36d2f5 for instance with vm_state active and task_state deleting.
Apr 17 15:25:47 user nova-compute[82617]: INFO nova.compute.manager [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Took 0.84 seconds to detach 1 volumes for instance.
Apr 17 15:25:47 user nova-compute[82617]: DEBUG nova.compute.manager [req-4018d577-fe1e-41e2-8c21-235b1c0669f8 req-5e62f81f-08b0-423c-90bb-0580d1e4f096 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-changed-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG nova.compute.manager [req-4018d577-fe1e-41e2-8c21-235b1c0669f8 req-5e62f81f-08b0-423c-90bb-0580d1e4f096 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Refreshing instance network info cache due to event network-changed-3318391f-7474-432a-ab24-5eec02673b8b. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-4018d577-fe1e-41e2-8c21-235b1c0669f8 req-5e62f81f-08b0-423c-90bb-0580d1e4f096 service nova] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-4018d577-fe1e-41e2-8c21-235b1c0669f8 req-5e62f81f-08b0-423c-90bb-0580d1e4f096 service nova] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG nova.network.neutron [req-4018d577-fe1e-41e2-8c21-235b1c0669f8 req-5e62f81f-08b0-423c-90bb-0580d1e4f096 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Refreshing network info cache for port 3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:47 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Deleted allocations for instance 70667df1-34e8-4063-a2fc-1fc7d63318f9
Apr 17 15:25:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-292d6e35-8ff9-4d0c-87e6-e4b27b69e96d tempest-DeleteServersTestJSON-1458225442 tempest-DeleteServersTestJSON-1458225442-project-member] Lock "70667df1-34e8-4063-a2fc-1fc7d63318f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.599s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG nova.network.neutron [req-4018d577-fe1e-41e2-8c21-235b1c0669f8 req-5e62f81f-08b0-423c-90bb-0580d1e4f096 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated VIF entry in instance network info cache for port 3318391f-7474-432a-ab24-5eec02673b8b. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG nova.network.neutron [req-4018d577-fe1e-41e2-8c21-235b1c0669f8 req-5e62f81f-08b0-423c-90bb-0580d1e4f096 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-4018d577-fe1e-41e2-8c21-235b1c0669f8 req-5e62f81f-08b0-423c-90bb-0580d1e4f096 service nova] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-f159ebf7-320c-47eb-a7d7-db4a8d01a900 req-4e965aef-a61a-4c02-bccd-dc2607223e90 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-f159ebf7-320c-47eb-a7d7-db4a8d01a900 req-4e965aef-a61a-4c02-bccd-dc2607223e90 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing instance network info cache due to event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f159ebf7-320c-47eb-a7d7-db4a8d01a900 req-4e965aef-a61a-4c02-bccd-dc2607223e90 service nova] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f159ebf7-320c-47eb-a7d7-db4a8d01a900 req-4e965aef-a61a-4c02-bccd-dc2607223e90 service nova] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG nova.network.neutron [req-f159ebf7-320c-47eb-a7d7-db4a8d01a900 req-4e965aef-a61a-4c02-bccd-dc2607223e90 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG nova.network.neutron [req-f159ebf7-320c-47eb-a7d7-db4a8d01a900 req-4e965aef-a61a-4c02-bccd-dc2607223e90 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated VIF entry in instance network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG nova.network.neutron [req-f159ebf7-320c-47eb-a7d7-db4a8d01a900 req-4e965aef-a61a-4c02-bccd-dc2607223e90 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f159ebf7-320c-47eb-a7d7-db4a8d01a900 req-4e965aef-a61a-4c02-bccd-dc2607223e90 service nova] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:50 user nova-compute[82617]: INFO nova.compute.manager [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] instance snapshotting
Apr 17 15:25:50 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Beginning live snapshot process
Apr 17 15:25:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json -f qcow2 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json -f qcow2 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json -f qcow2" returned: 0 in 0.160s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdh4xt6_y/daa510374f4e45308880d7c352702865.delta 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdh4xt6_y/daa510374f4e45308880d7c352702865.delta 1073741824" returned: 0 in 0.051s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:51 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 17 15:25:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:25:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:25:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 17 15:25:52 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:25:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdh4xt6_y/daa510374f4e45308880d7c352702865.delta /opt/stack/data/nova/instances/snapshots/tmpdh4xt6_y/daa510374f4e45308880d7c352702865 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-2465cd07-c7ac-4546-a607-631b441afaf2 req-d3fc5e67-2b6a-4dcb-973d-a8ffda8bb0f1 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-changed-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-2465cd07-c7ac-4546-a607-631b441afaf2 req-d3fc5e67-2b6a-4dcb-973d-a8ffda8bb0f1 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Refreshing instance network info cache due to event network-changed-3ae715f2-409f-4855-94cc-3bbb6cbf1b41. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:25:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2465cd07-c7ac-4546-a607-631b441afaf2 req-d3fc5e67-2b6a-4dcb-973d-a8ffda8bb0f1 service nova] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:25:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2465cd07-c7ac-4546-a607-631b441afaf2 req-d3fc5e67-2b6a-4dcb-973d-a8ffda8bb0f1 service nova] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:25:52 user nova-compute[82617]: DEBUG nova.network.neutron [req-2465cd07-c7ac-4546-a607-631b441afaf2 req-d3fc5e67-2b6a-4dcb-973d-a8ffda8bb0f1 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Refreshing network info cache for port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:25:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdh4xt6_y/daa510374f4e45308880d7c352702865.delta /opt/stack/data/nova/instances/snapshots/tmpdh4xt6_y/daa510374f4e45308880d7c352702865" returned: 0 in 0.382s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:53 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Snapshot extracted, beginning image upload
Apr 17 15:25:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-2465cd07-c7ac-4546-a607-631b441afaf2 req-d3fc5e67-2b6a-4dcb-973d-a8ffda8bb0f1 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updated VIF entry in instance network info cache for port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:25:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-2465cd07-c7ac-4546-a607-631b441afaf2 req-d3fc5e67-2b6a-4dcb-973d-a8ffda8bb0f1 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:25:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2465cd07-c7ac-4546-a607-631b441afaf2 req-d3fc5e67-2b6a-4dcb-973d-a8ffda8bb0f1 service nova] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:25:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Snapshot image upload complete
Apr 17 15:25:55 user nova-compute[82617]: INFO nova.compute.manager [None req-aea660c4-914a-4f71-abc4-78d4a94b1483 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Took 5.09 seconds to snapshot the instance on the hypervisor.
Apr 17 15:25:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:56 user nova-compute[82617]: INFO nova.compute.manager [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Shelving
Apr 17 15:25:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-065ec270-10ac-4362-891b-ec27307732e5 req-7be4a628-9ae2-4fa5-8d1b-8b6195bd9c52 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-unplugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-065ec270-10ac-4362-891b-ec27307732e5 req-7be4a628-9ae2-4fa5-8d1b-8b6195bd9c52 service nova] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-065ec270-10ac-4362-891b-ec27307732e5 req-7be4a628-9ae2-4fa5-8d1b-8b6195bd9c52 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-065ec270-10ac-4362-891b-ec27307732e5 req-7be4a628-9ae2-4fa5-8d1b-8b6195bd9c52 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-065ec270-10ac-4362-891b-ec27307732e5 req-7be4a628-9ae2-4fa5-8d1b-8b6195bd9c52 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] No waiting events found dispatching network-vif-unplugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:56 user nova-compute[82617]: WARNING nova.compute.manager [req-065ec270-10ac-4362-891b-ec27307732e5 req-7be4a628-9ae2-4fa5-8d1b-8b6195bd9c52 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received unexpected event network-vif-unplugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 for instance with vm_state active and task_state shelving.
Apr 17 15:25:57 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance destroyed successfully.
Apr 17 15:25:57 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Beginning cold snapshot process
Apr 17 15:25:57 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:25:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk /opt/stack/data/nova/instances/snapshots/tmpr9dm25t6/91563aa4a04f408897242c21d07dabde {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:25:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk /opt/stack/data/nova/instances/snapshots/tmpr9dm25t6/91563aa4a04f408897242c21d07dabde" returned: 0 in 0.547s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:25:57 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Snapshot extracted, beginning image upload
Apr 17 15:25:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-7b9fbca9-4055-4c91-90d8-4888f270f6e6 req-6f712e80-fe7a-4fd6-a549-5f4c87e2d555 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:25:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7b9fbca9-4055-4c91-90d8-4888f270f6e6 req-6f712e80-fe7a-4fd6-a549-5f4c87e2d555 service nova] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:25:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7b9fbca9-4055-4c91-90d8-4888f270f6e6 req-6f712e80-fe7a-4fd6-a549-5f4c87e2d555 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:25:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7b9fbca9-4055-4c91-90d8-4888f270f6e6 req-6f712e80-fe7a-4fd6-a549-5f4c87e2d555 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:25:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-7b9fbca9-4055-4c91-90d8-4888f270f6e6 req-6f712e80-fe7a-4fd6-a549-5f4c87e2d555 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] No waiting events found dispatching network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:25:59 user nova-compute[82617]: WARNING nova.compute.manager [req-7b9fbca9-4055-4c91-90d8-4888f270f6e6 req-6f712e80-fe7a-4fd6-a549-5f4c87e2d555 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received unexpected event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 for instance with vm_state active and task_state shelving_image_uploading.
Apr 17 15:25:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:59 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745144.8501997, 70667df1-34e8-4063-a2fc-1fc7d63318f9 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:25:59 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] VM Stopped (Lifecycle Event)
Apr 17 15:25:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-bfcb6508-d278-4041-9e51-624abcf9eb1b None None] [instance: 70667df1-34e8-4063-a2fc-1fc7d63318f9] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:25:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:25:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Snapshot image upload complete
Apr 17 15:25:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:26:00 user nova-compute[82617]: INFO nova.compute.manager [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Shelve offloading
Apr 17 15:26:00 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance destroyed successfully.
Apr 17 15:26:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:26:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:00 user nova-compute[82617]: DEBUG nova.network.neutron [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.network.neutron [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:01 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance destroyed successfully.
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.objects.instance [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'resources' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-474197410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-474197410',id=4,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaV5vFW5tSygMV/NjPz/shhbcvvyXgIAkaTiBn6tH7J/Mye3Ceh6X2NAQjgM8DqKIlKuMD3s9S4hv0vkh4ho64Mh7ytYIRT4djMpVqyPPj6yRhbanlyE17Pj7gUlgQXBA==',key_name='tempest-keypair-1690039047',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-qleldwb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member',shelved_at='2023-04-17T15:25:59.963878',shelved_host='user',shelved_image_id='d9191886-1044-415b-8fe4-4811959464e3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=6aab9803-ab51-47c6-a2a2-739a7a18f5dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG os_vif [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ae715f2-40, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-58f21ffb-ae8d-43f9-9513-39b0dbb23711 req-35473b8e-2690-4e31-881e-d57ab33d562d service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-changed-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-58f21ffb-ae8d-43f9-9513-39b0dbb23711 req-35473b8e-2690-4e31-881e-d57ab33d562d service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Refreshing instance network info cache due to event network-changed-3ae715f2-409f-4855-94cc-3bbb6cbf1b41. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-58f21ffb-ae8d-43f9-9513-39b0dbb23711 req-35473b8e-2690-4e31-881e-d57ab33d562d service nova] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-58f21ffb-ae8d-43f9-9513-39b0dbb23711 req-35473b8e-2690-4e31-881e-d57ab33d562d service nova] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.network.neutron [req-58f21ffb-ae8d-43f9-9513-39b0dbb23711 req-35473b8e-2690-4e31-881e-d57ab33d562d service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Refreshing network info cache for port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:26:01 user nova-compute[82617]: INFO os_vif [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40')
Apr 17 15:26:01 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Deleting instance files /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc_del
Apr 17 15:26:01 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Deletion of /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc_del complete
Apr 17 15:26:01 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Deleted allocations for instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc
Apr 17 15:26:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:01 user nova-compute[82617]: DEBUG nova.objects.instance [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'numa_topology' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:02 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:26:02 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:26:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:02 user nova-compute[82617]: DEBUG nova.network.neutron [req-58f21ffb-ae8d-43f9-9513-39b0dbb23711 req-35473b8e-2690-4e31-881e-d57ab33d562d service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updated VIF entry in instance network info cache for port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:26:02 user nova-compute[82617]: DEBUG nova.network.neutron [req-58f21ffb-ae8d-43f9-9513-39b0dbb23711 req-35473b8e-2690-4e31-881e-d57ab33d562d service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3ae715f2-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-58f21ffb-ae8d-43f9-9513-39b0dbb23711 req-35473b8e-2690-4e31-881e-d57ab33d562d service nova] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a4446d96-9391-4997-9a92-1a360b362638 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.004s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-0f0454f0-bd84-4e68-953b-ef2026138290 req-78e5664f-666b-4724-b329-6d04374d65e8 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received event network-changed-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-0f0454f0-bd84-4e68-953b-ef2026138290 req-78e5664f-666b-4724-b329-6d04374d65e8 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Refreshing instance network info cache due to event network-changed-5ff3398f-eb1e-477e-9678-d331ee7f278d. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:26:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0f0454f0-bd84-4e68-953b-ef2026138290 req-78e5664f-666b-4724-b329-6d04374d65e8 service nova] Acquiring lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0f0454f0-bd84-4e68-953b-ef2026138290 req-78e5664f-666b-4724-b329-6d04374d65e8 service nova] Acquired lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-0f0454f0-bd84-4e68-953b-ef2026138290 req-78e5664f-666b-4724-b329-6d04374d65e8 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Refreshing network info cache for port 5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:26:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-0f0454f0-bd84-4e68-953b-ef2026138290 req-78e5664f-666b-4724-b329-6d04374d65e8 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updated VIF entry in instance network info cache for port 5ff3398f-eb1e-477e-9678-d331ee7f278d. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:26:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-0f0454f0-bd84-4e68-953b-ef2026138290 req-78e5664f-666b-4724-b329-6d04374d65e8 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updating instance_info_cache with network_info: [{"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0f0454f0-bd84-4e68-953b-ef2026138290 req-78e5664f-666b-4724-b329-6d04374d65e8 service nova] Releasing lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG nova.objects.instance [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'flavor' on Instance uuid df469608-5f17-4f70-8933-fe92adcd3837 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:10 user nova-compute[82617]: INFO nova.compute.manager [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Attaching volume 215a6a5b-25ca-48fa-a8e3-72416d7a39e2 to /dev/vdb
Apr 17 15:26:10 user nova-compute[82617]: DEBUG os_brick.utils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[677aca85-5421-4e21-8c6f-eb5650455f57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fb909e-108b-46c5-b4c2-2d4910bd8a69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6168c37-b108-40cc-9b88-921f5e48ac94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c61735-ce1f-4b3d-b7e3-34e8a57a5b8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:11 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:26:11 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed29d0bf-451c-4bcd-a4fb-485a1338dfc7]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG os_brick.utils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updating existing volume attachment record: 5b4d8d41-f27c-477b-9bbd-0437f5a2d910 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:26:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:12 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745157.1685603, 6aab9803-ab51-47c6-a2a2-739a7a18f5dc => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:26:12 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] VM Stopped (Lifecycle Event)
Apr 17 15:26:12 user nova-compute[82617]: DEBUG nova.compute.manager [None req-71bca241-7f77-4a56-9cd0-17ca79e4b256 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:26:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-67c65a5c-8687-49e1-a6dc-bc959daaf6e7 req-58ce5177-09c6-490e-9f52-94191303393e service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received event network-changed-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-67c65a5c-8687-49e1-a6dc-bc959daaf6e7 req-58ce5177-09c6-490e-9f52-94191303393e service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Refreshing instance network info cache due to event network-changed-159f4c8b-7692-4b13-8c6a-884b6ccd8964. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:26:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-67c65a5c-8687-49e1-a6dc-bc959daaf6e7 req-58ce5177-09c6-490e-9f52-94191303393e service nova] Acquiring lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-67c65a5c-8687-49e1-a6dc-bc959daaf6e7 req-58ce5177-09c6-490e-9f52-94191303393e service nova] Acquired lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:13 user nova-compute[82617]: DEBUG nova.network.neutron [req-67c65a5c-8687-49e1-a6dc-bc959daaf6e7 req-58ce5177-09c6-490e-9f52-94191303393e service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Refreshing network info cache for port 159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-aec2737c-66a4-41a2-b926-b2ecd465a376 req-8e5ca4cd-cd30-4ae6-b5f3-61be64c79584 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received event network-changed-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-aec2737c-66a4-41a2-b926-b2ecd465a376 req-8e5ca4cd-cd30-4ae6-b5f3-61be64c79584 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Refreshing instance network info cache due to event network-changed-991a008c-046e-454f-a14c-e4a8bed88a6b. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-aec2737c-66a4-41a2-b926-b2ecd465a376 req-8e5ca4cd-cd30-4ae6-b5f3-61be64c79584 service nova] Acquiring lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-aec2737c-66a4-41a2-b926-b2ecd465a376 req-8e5ca4cd-cd30-4ae6-b5f3-61be64c79584 service nova] Acquired lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-aec2737c-66a4-41a2-b926-b2ecd465a376 req-8e5ca4cd-cd30-4ae6-b5f3-61be64c79584 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Refreshing network info cache for port 991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-67c65a5c-8687-49e1-a6dc-bc959daaf6e7 req-58ce5177-09c6-490e-9f52-94191303393e service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Updated VIF entry in instance network info cache for port 159f4c8b-7692-4b13-8c6a-884b6ccd8964. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-67c65a5c-8687-49e1-a6dc-bc959daaf6e7 req-58ce5177-09c6-490e-9f52-94191303393e service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Updating instance_info_cache with network_info: [{"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-67c65a5c-8687-49e1-a6dc-bc959daaf6e7 req-58ce5177-09c6-490e-9f52-94191303393e service nova] Releasing lock "refresh_cache-3456d072-ae41-4bd2-bd5d-3622a9a5a23d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG nova.objects.instance [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lazy-loading 'flavor' on Instance uuid 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:15 user nova-compute[82617]: INFO nova.compute.manager [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Attaching volume 66000c93-eb12-4c23-8a69-71e1aa6b521f to /dev/vdb
Apr 17 15:26:15 user nova-compute[82617]: DEBUG os_brick.utils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bf2b00-63cc-45d1-95ee-dfd7de2d8198]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda8b346-0dda-4783-8676-c3869f8dd71b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0ef10-d0ab-4f6b-a4d0-c4a614930c0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[22890ff1-b7c2-4d4b-b5de-cef815f08e35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:15 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eecd752-5888-407b-aab9-55a85c86141d]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG os_brick.utils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Updating existing volume attachment record: ed5eb659-cd00-475c-bec2-daa30716b18a {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "interface-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "interface-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.objects.instance [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'flavor' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.network.neutron [req-aec2737c-66a4-41a2-b926-b2ecd465a376 req-8e5ca4cd-cd30-4ae6-b5f3-61be64c79584 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Updated VIF entry in instance network info cache for port 991a008c-046e-454f-a14c-e4a8bed88a6b. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.network.neutron [req-aec2737c-66a4-41a2-b926-b2ecd465a376 req-8e5ca4cd-cd30-4ae6-b5f3-61be64c79584 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Updating instance_info_cache with network_info: [{"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-aec2737c-66a4-41a2-b926-b2ecd465a376 req-8e5ca4cd-cd30-4ae6-b5f3-61be64c79584 service nova] Releasing lock "refresh_cache-109c9a23-751e-4b29-abcf-0f003adb35cc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.objects.instance [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'pci_requests' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-82a09be0-d95e-4216-ae0e-0e0f61ef2cf5 req-e06c6f70-5733-47de-9401-4635d5080700 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-changed-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-82a09be0-d95e-4216-ae0e-0e0f61ef2cf5 req-e06c6f70-5733-47de-9401-4635d5080700 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Refreshing instance network info cache due to event network-changed-d1c7ec7e-3825-4422-ae8b-82505961b10d. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-82a09be0-d95e-4216-ae0e-0e0f61ef2cf5 req-e06c6f70-5733-47de-9401-4635d5080700 service nova] Acquiring lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-82a09be0-d95e-4216-ae0e-0e0f61ef2cf5 req-e06c6f70-5733-47de-9401-4635d5080700 service nova] Acquired lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.network.neutron [req-82a09be0-d95e-4216-ae0e-0e0f61ef2cf5 req-e06c6f70-5733-47de-9401-4635d5080700 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Refreshing network info cache for port d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:26:15 user nova-compute[82617]: DEBUG nova.policy [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f081ecb75ec14053b68d74cacf61c802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa73323c3c4c689f4012505d8b4833', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:26:16 user nova-compute[82617]: DEBUG nova.network.neutron [req-82a09be0-d95e-4216-ae0e-0e0f61ef2cf5 req-e06c6f70-5733-47de-9401-4635d5080700 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updated VIF entry in instance network info cache for port d1c7ec7e-3825-4422-ae8b-82505961b10d. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:26:16 user nova-compute[82617]: DEBUG nova.network.neutron [req-82a09be0-d95e-4216-ae0e-0e0f61ef2cf5 req-e06c6f70-5733-47de-9401-4635d5080700 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating instance_info_cache with network_info: [{"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-82a09be0-d95e-4216-ae0e-0e0f61ef2cf5 req-e06c6f70-5733-47de-9401-4635d5080700 service nova] Releasing lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:16 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Successfully created port: 2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:26:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Successfully updated port: 2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquired lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-e097076f-8ca7-4604-a23f-d6b049c58109 req-25bebf5a-b744-461b-92ca-ba417ba6017b service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-changed-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-e097076f-8ca7-4604-a23f-d6b049c58109 req-25bebf5a-b744-461b-92ca-ba417ba6017b service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Refreshing instance network info cache due to event network-changed-2e6247a6-c703-45d5-8e58-f29ff870b3a4. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e097076f-8ca7-4604-a23f-d6b049c58109 req-25bebf5a-b744-461b-92ca-ba417ba6017b service nova] Acquiring lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIJnMDkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:17 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:17 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:17 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a446df6f-38a6-4ca4-89d2-bfaaba2a02ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:26:17 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG nova.objects.instance [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lazy-loading 'flavor' on Instance uuid 3456d072-ae41-4bd2-bd5d-3622a9a5a23d {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b276a7aa-843a-43db-b7b6-9b4c6b9f0d7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2] added
Apr 17 15:26:17 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8b819a-80eb-4804-afd9-fe8ccb53ccc2]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57e693b-c3dc-48c9-8dc3-b7f807e225ef]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIJnMDkU {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIJnMDkU" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[6070b819-1e11-4b8b-9801-abdabe58b39c]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wIJnMDkU'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c226266f-8d63-470a-ac5e-b4074cfd7acb]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[00831f60-2f4c-41bc-87cf-f7f8bec552e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2398fe9b-cb9f-4cd6-86d2-d3c790242378]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2, portal: 172.16.0.220,3260]
Apr 17 15:26:17 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:17 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:17 user nova-compute[82617]: INFO nova.compute.manager [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Attaching volume bf63d38e-00b8-46cb-acce-fda3fd9b6a9f to /dev/sdc
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf1ff8c-6c1a-4fe4-88e8-9a94d55d7d5d]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3ff775-5bd3-4d21-b4bd-48ca0cff1c69]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)
Apr 17 15:26:17 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.utils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f21354-5115-4fd5-91a1-df58c0bc26b7]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIJnMDkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c2d057-4ea4-4c22-8402-b63c6c066b1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba03816f-0750-40e2-b9c0-c037e7138f44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d65433-a189-4e6e-8bc8-bd5d611b1bfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd1f1a-f441-4792-95ea-1a581be2c4af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:17 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:26:17 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a069c752-c187-42a0-89da-6dddd464b70d]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG os_brick.utils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:17 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Updating existing volume attachment record: f80a0217-be74-40ad-a93c-7295129cd655 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating instance_info_cache with network_info: [{"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Releasing lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e097076f-8ca7-4604-a23f-d6b049c58109 req-25bebf5a-b744-461b-92ca-ba417ba6017b service nova] Acquired lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.network.neutron [req-e097076f-8ca7-4604-a23f-d6b049c58109 req-25bebf5a-b744-461b-92ca-ba417ba6017b service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Refreshing network info cache for port 2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1823140976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1823140976',id=8,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUfHnESoVXPXi9ptdNvQZ84Ee9hbXkk0ExtIQFN0+4bRf8Gw1SKqE0OkJ3a+urW6oJfBopuykh0VzTN212r/3wGIPauF1zsICIzN843Fa+vOY9Vmjx0m4DGpvIcKrqkuQ==',key_name='tempest-keypair-201206862',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dfa73323c3c4c689f4012505d8b4833',ramdisk_id='',reservation_id='r-f1zz6xdu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1309189231',owner_user_name='tempest-TaggedAttachmentsTest-1309189231-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f081ecb75ec14053b68d74cacf61c802',uuid=c1fafed5-dcf8-4bac-8b38-f2067e47bd1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converting VIF {"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:59:cf,bridge_name='br-int',has_traffic_filtering=True,id=2e6247a6-c703-45d5-8e58-f29ff870b3a4,network=Network(b29112be-2108-4b35-8d7f-58985a18b6e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6247a6-c7') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG os_vif [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:59:cf,bridge_name='br-int',has_traffic_filtering=True,id=2e6247a6-c703-45d5-8e58-f29ff870b3a4,network=Network(b29112be-2108-4b35-8d7f-58985a18b6e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6247a6-c7') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e6247a6-c7, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e6247a6-c7, col_values=(('external_ids', {'iface-id': '2e6247a6-c703-45d5-8e58-f29ff870b3a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:59:cf', 'vm-uuid': 'c1fafed5-dcf8-4bac-8b38-f2067e47bd1c'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: INFO os_vif [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:59:cf,bridge_name='br-int',has_traffic_filtering=True,id=2e6247a6-c703-45d5-8e58-f29ff870b3a4,network=Network(b29112be-2108-4b35-8d7f-58985a18b6e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6247a6-c7')
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1823140976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1823140976',id=8,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUfHnESoVXPXi9ptdNvQZ84Ee9hbXkk0ExtIQFN0+4bRf8Gw1SKqE0OkJ3a+urW6oJfBopuykh0VzTN212r/3wGIPauF1zsICIzN843Fa+vOY9Vmjx0m4DGpvIcKrqkuQ==',key_name='tempest-keypair-201206862',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dfa73323c3c4c689f4012505d8b4833',ramdisk_id='',reservation_id='r-f1zz6xdu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1309189231',owner_user_name='tempest-TaggedAttachmentsTest-1309189231-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f081ecb75ec14053b68d74cacf61c802',uuid=c1fafed5-dcf8-4bac-8b38-f2067e47bd1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converting VIF {"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:59:cf,bridge_name='br-int',has_traffic_filtering=True,id=2e6247a6-c703-45d5-8e58-f29ff870b3a4,network=Network(b29112be-2108-4b35-8d7f-58985a18b6e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6247a6-c7') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] attach device xml: <interface type="ethernet">
Apr 17 15:26:18 user nova-compute[82617]:   <mac address="fa:16:3e:ba:59:cf"/>
Apr 17 15:26:18 user nova-compute[82617]:   <model type="virtio"/>
Apr 17 15:26:18 user nova-compute[82617]:   <mtu size="1442"/>
Apr 17 15:26:18 user nova-compute[82617]:   <target dev="tap2e6247a6-c7"/>
Apr 17 15:26:18 user nova-compute[82617]: </interface>
Apr 17 15:26:18 user nova-compute[82617]:  {{(pid=82617) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No BDM found with device name hda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No VIF found with MAC fa:16:3e:cb:da:dc, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:26:18 user nova-compute[82617]:   <nova:package version="0.0.0"/>
Apr 17 15:26:18 user nova-compute[82617]:   <nova:name>tempest-device-tagging-server-1823140976</nova:name>
Apr 17 15:26:18 user nova-compute[82617]:   <nova:creationTime>2023-04-17 15:26:18</nova:creationTime>
Apr 17 15:26:18 user nova-compute[82617]:   <nova:flavor name="m1.nano">
Apr 17 15:26:18 user nova-compute[82617]:     <nova:memory>128</nova:memory>
Apr 17 15:26:18 user nova-compute[82617]:     <nova:disk>1</nova:disk>
Apr 17 15:26:18 user nova-compute[82617]:     <nova:swap>0</nova:swap>
Apr 17 15:26:18 user nova-compute[82617]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:26:18 user nova-compute[82617]:     <nova:vcpus>1</nova:vcpus>
Apr 17 15:26:18 user nova-compute[82617]:   </nova:flavor>
Apr 17 15:26:18 user nova-compute[82617]:   <nova:owner>
Apr 17 15:26:18 user nova-compute[82617]:     <nova:user uuid="f081ecb75ec14053b68d74cacf61c802">tempest-TaggedAttachmentsTest-1309189231-project-member</nova:user>
Apr 17 15:26:18 user nova-compute[82617]:     <nova:project uuid="9dfa73323c3c4c689f4012505d8b4833">tempest-TaggedAttachmentsTest-1309189231</nova:project>
Apr 17 15:26:18 user nova-compute[82617]:   </nova:owner>
Apr 17 15:26:18 user nova-compute[82617]:   <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:26:18 user nova-compute[82617]:   <nova:ports>
Apr 17 15:26:18 user nova-compute[82617]:     <nova:port uuid="d1c7ec7e-3825-4422-ae8b-82505961b10d">
Apr 17 15:26:18 user nova-compute[82617]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 15:26:18 user nova-compute[82617]:     </nova:port>
Apr 17 15:26:18 user nova-compute[82617]:     <nova:port uuid="2e6247a6-c703-45d5-8e58-f29ff870b3a4">
Apr 17 15:26:18 user nova-compute[82617]:       <nova:ip type="fixed" address="10.10.10.157" ipVersion="4"/>
Apr 17 15:26:18 user nova-compute[82617]:     </nova:port>
Apr 17 15:26:18 user nova-compute[82617]:   </nova:ports>
Apr 17 15:26:18 user nova-compute[82617]: </nova:instance>
Apr 17 15:26:18 user nova-compute[82617]:  {{(pid=82617) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26631343631356166', 'path': '/dev/sdf'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631343631356166', 'path': '/dev/sdf'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.objects.instance [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'flavor' on Instance uuid df469608-5f17-4f70-8933-fe92adcd3837 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8907ab97-d62c-475b-bcdf-3705985efe75 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "interface-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.350s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 15:26:18 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:18 user nova-compute[82617]:   <source dev="/dev/sdf"/>
Apr 17 15:26:18 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:26:18 user nova-compute[82617]:   <serial>215a6a5b-25ca-48fa-a8e3-72416d7a39e2</serial>
Apr 17 15:26:18 user nova-compute[82617]: </disk>
Apr 17 15:26:18 user nova-compute[82617]:  {{(pid=82617) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.objects.instance [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'flavor' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] No VIF found with MAC fa:16:3e:61:76:e7, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:19 user nova-compute[82617]: INFO nova.compute.manager [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Attaching volume 3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a to /dev/vdb
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-16569f56-3a92-48d7-bd36-396b19817e9c tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.425s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG os_brick.utils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb21ed0-5c5d-4666-bcea-8c967a95bad6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ff7b4-d217-4208-8ab4-54700472453e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d2f8ec-f57d-4696-ad53-8029d6eec90c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4a0ba-066a-4aae-9f3f-7cd58f87f5a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:19 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a80f45-a185-42f3-b61a-a0c98ed2b61e]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG os_brick.utils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating existing volume attachment record: 3ada793a-9b05-4c8b-9dfb-27728f2edf3f {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.compute.manager [req-db2cb2d5-e232-4e38-a776-97e52d19de04 req-8bcff074-c7c4-42bf-8aed-c04cc47236e6 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-db2cb2d5-e232-4e38-a776-97e52d19de04 req-8bcff074-c7c4-42bf-8aed-c04cc47236e6 service nova] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-db2cb2d5-e232-4e38-a776-97e52d19de04 req-8bcff074-c7c4-42bf-8aed-c04cc47236e6 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-db2cb2d5-e232-4e38-a776-97e52d19de04 req-8bcff074-c7c4-42bf-8aed-c04cc47236e6 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.compute.manager [req-db2cb2d5-e232-4e38-a776-97e52d19de04 req-8bcff074-c7c4-42bf-8aed-c04cc47236e6 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] No waiting events found dispatching network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:19 user nova-compute[82617]: WARNING nova.compute.manager [req-db2cb2d5-e232-4e38-a776-97e52d19de04 req-8bcff074-c7c4-42bf-8aed-c04cc47236e6 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received unexpected event network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 for instance with vm_state active and task_state None.
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.network.neutron [req-e097076f-8ca7-4604-a23f-d6b049c58109 req-25bebf5a-b744-461b-92ca-ba417ba6017b service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updated VIF entry in instance network info cache for port 2e6247a6-c703-45d5-8e58-f29ff870b3a4. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG nova.network.neutron [req-e097076f-8ca7-4604-a23f-d6b049c58109 req-25bebf5a-b744-461b-92ca-ba417ba6017b service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating instance_info_cache with network_info: [{"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e097076f-8ca7-4604-a23f-d6b049c58109 req-25bebf5a-b744-461b-92ca-ba417ba6017b service nova] Releasing lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:21 user nova-compute[82617]: DEBUG nova.compute.manager [req-3fba4d99-7bf6-4e30-acae-6072ee991ceb req-a4aeed10-c511-477b-b169-7f40404a6389 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3fba4d99-7bf6-4e30-acae-6072ee991ceb req-a4aeed10-c511-477b-b169-7f40404a6389 service nova] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3fba4d99-7bf6-4e30-acae-6072ee991ceb req-a4aeed10-c511-477b-b169-7f40404a6389 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3fba4d99-7bf6-4e30-acae-6072ee991ceb req-a4aeed10-c511-477b-b169-7f40404a6389 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:21 user nova-compute[82617]: DEBUG nova.compute.manager [req-3fba4d99-7bf6-4e30-acae-6072ee991ceb req-a4aeed10-c511-477b-b169-7f40404a6389 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] No waiting events found dispatching network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:21 user nova-compute[82617]: WARNING nova.compute.manager [req-3fba4d99-7bf6-4e30-acae-6072ee991ceb req-a4aeed10-c511-477b-b169-7f40404a6389 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received unexpected event network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 for instance with vm_state active and task_state None.
Apr 17 15:26:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:27 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:27 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:27 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d037403-7637-4a18-84d1-60ab912e3443]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:26:27 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[00938712-df41-4e4b-bf1b-ddbb5022ad78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f] added
Apr 17 15:26:27 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86ee282-dfbf-4b46-a864-29d94f466e91]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9825101-9c40-49dc-99c4-cc0bb8f132c1]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygxXCJfw {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygxXCJfw" returned: 0 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5428d286-f287-413c-84be-75d9d6a697e0]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygxXCJfw'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f339e73f-3213-4c55-a8e0-537c5add300a]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b5d32f-9213-49c5-97a9-dc87ec6d7ab4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae641493-0cb7-4809-af40-7d3db52ebb3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260]
Apr 17 15:26:27 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:27 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca07d775-a65a-4a17-978a-d0c36abfb22a]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b604389-19d9-4f8f-9271-3720542d666f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:27 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)
Apr 17 15:26:27 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:27 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a398c4-aa37-4e43-b2d3-24db9124c57a]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:26:27 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:28 user nova-compute[82617]: INFO nova.compute.manager [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Detaching volume 215a6a5b-25ca-48fa-a8e3-72416d7a39e2
Apr 17 15:26:28 user nova-compute[82617]: INFO nova.virt.block_device [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Attempting to driver detach volume 215a6a5b-25ca-48fa-a8e3-72416d7a39e2 from mountpoint /dev/vdb
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Attempting to detach device vdb from instance df469608-5f17-4f70-8933-fe92adcd3837 from the persistent domain config. {{(pid=82617) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:26:28 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:28 user nova-compute[82617]:   <source dev="/dev/sdf"/>
Apr 17 15:26:28 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:26:28 user nova-compute[82617]:   <serial>215a6a5b-25ca-48fa-a8e3-72416d7a39e2</serial>
Apr 17 15:26:28 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 15:26:28 user nova-compute[82617]: </disk>
Apr 17 15:26:28 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:26:28 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Successfully detached device vdb from instance df469608-5f17-4f70-8933-fe92adcd3837 from the persistent domain config.
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df469608-5f17-4f70-8933-fe92adcd3837 from the live domain config. {{(pid=82617) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:26:28 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:28 user nova-compute[82617]:   <source dev="/dev/sdf"/>
Apr 17 15:26:28 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:26:28 user nova-compute[82617]:   <serial>215a6a5b-25ca-48fa-a8e3-72416d7a39e2</serial>
Apr 17 15:26:28 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 15:26:28 user nova-compute[82617]: </disk>
Apr 17 15:26:28 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23338626565376231', 'path': '/dev/sdg'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338626565376231', 'path': '/dev/sdg'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.objects.instance [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lazy-loading 'flavor' on Instance uuid 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df469608-5f17-4f70-8933-fe92adcd3837 {{(pid=82617) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Received event <DeviceRemovedEvent: 1681745188.8519769, df469608-5f17-4f70-8933-fe92adcd3837 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82617) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 15:26:28 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Successfully detached device vdb from instance df469608-5f17-4f70-8933-fe92adcd3837 from the live domain config.
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 15:26:28 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:28 user nova-compute[82617]:   <source dev="/dev/sdg"/>
Apr 17 15:26:28 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:26:28 user nova-compute[82617]:   <serial>66000c93-eb12-4c23-8a69-71e1aa6b521f</serial>
Apr 17 15:26:28 user nova-compute[82617]: </disk>
Apr 17 15:26:28 user nova-compute[82617]:  {{(pid=82617) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIJnMDkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:28 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3628d3-03a2-44b7-9654-39f4c0782dc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:26:28 user nova-compute[82617]: No targets found.
Apr 17 15:26:28 user nova-compute[82617]: iSNS:
Apr 17 15:26:28 user nova-compute[82617]: No targets found.
Apr 17 15:26:28 user nova-compute[82617]: STATIC:
Apr 17 15:26:28 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2
Apr 17 15:26:28 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:28 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:28 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310
Apr 17 15:26:28 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:28 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:28 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f
Apr 17 15:26:28 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:28 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:28 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f
Apr 17 15:26:28 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:28 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:28 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:26:28 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:28 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:28 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c
Apr 17 15:26:28 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:28 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:28 user nova-compute[82617]: FIRMWARE:
Apr 17 15:26:28 user nova-compute[82617]: No targets found.
Apr 17 15:26:28 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:26:28 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:26:28 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[22112c2d-1e54-4eb6-bd03-dd3b749047c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef590bfb-311b-455b-81ac-7ca598fb6efd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:28 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 (non-flash)
Apr 17 15:26:28 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:28 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64870aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2'): ({'sdf'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Removing single pathed devices sdf {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[826a8397-ddd4-4485-8a6d-ff69015a6f98]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:28 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[1830ed1e-6279-447e-a71a-07a06baf1948]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Flushing IO for device /dev/sdf {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d4b726-fb82-4449-ac1e-3e6689e08822]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7ce47e-0b9b-4866-938b-291dd6eab24c]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] SCSI volumes sdf have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be5791b-5f25-45cb-a67f-6286925bf509]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b87ac-6d41-46a2-8a7b-45e287e5af6c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2, portal: 172.16.0.220,3260]
Apr 17 15:26:29 user nova-compute[82617]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:29 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215a6a5b-25ca-48fa-a8e3-72416d7a39e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d923dbfb-2245-4d33-8cfb-f580364864db]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] <== disconnect_volume: return (317ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] No VIF found with MAC fa:16:3e:70:df:aa, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSVisnfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:31 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:31 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:31 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7cde57-d6d2-4a9d-a745-9a2480ad919d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:26:31 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6373c4f-c077-4255-ae24-3098ffe26ada]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f] added
Apr 17 15:26:31 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3709da-122e-44cc-8fb2-37423fe5612b]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7be724e-3da5-48b2-915d-8565fd2af414]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSVisnfg {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSVisnfg" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e003dae9-5c13-48fd-9292-8b8b6d66b7d7]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xSVisnfg'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf2c048-bc9d-4ff9-8d2d-c6af4ab70545]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fad509-6aed-4088-ae02-4256b75cc1c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjBFoMiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:31 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b678f9-a4f5-4041-a7cb-2b537094f428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f, portal: 172.16.0.220,3260]
Apr 17 15:26:31 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:31 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c19f9d5-9328-456e-ad67-fbc31a960379]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0504a55-bc2d-4a9a-8198-47e8db7ae5d5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)
Apr 17 15:26:31 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:26:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7b740-f6cf-4998-9969-0da61daaa161]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.objects.instance [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'flavor' on Instance uuid df469608-5f17-4f70-8933-fe92adcd3837 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSVisnfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.894s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] <== connect_volume: return (895ms) {'type': 'block', 'scsi_wwn': '23932643732623665', 'path': '/dev/sdf'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932643732623665', 'path': '/dev/sdf'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.660s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:32 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:32 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:26:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7693MB free_disk=26.512317657470703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b14eb95-d004-4af2-b0c3-edf2409ede60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:26:32 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.objects.instance [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lazy-loading 'flavor' on Instance uuid 3456d072-ae41-4bd2-bd5d-3622a9a5a23d {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dae38c21-d185-4d26-9a00-f5ceddfb2d2b tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.777s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-47322ce3-978b-4118-82f4-5d45e902b32e tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.984s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8450014-c3a7-4e58-b4ef-4e221e0bb76a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a] added
Apr 17 15:26:32 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13d302e-4f5a-414a-936e-07195d56ae1c]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[741d01f7-434a-47c8-8eb9-4b17e77c02a1]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vjBFoMiS {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 15:26:32 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:32 user nova-compute[82617]:   <source dev="/dev/sdf"/>
Apr 17 15:26:32 user nova-compute[82617]:   <target dev="sdc" bus="scsi"/>
Apr 17 15:26:32 user nova-compute[82617]:   <serial>bf63d38e-00b8-46cb-acce-fda3fd9b6a9f</serial>
Apr 17 15:26:32 user nova-compute[82617]:   <address type="drive" controller="0" unit="2"/>
Apr 17 15:26:32 user nova-compute[82617]: </disk>
Apr 17 15:26:32 user nova-compute[82617]:  {{(pid=82617) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vjBFoMiS" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25cdba8-f559-4769-b58f-be0fe7db4bdf]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vjBFoMiS'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfdc1e1-71f4-4f1a-8409-141b44fc1413]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 109c9a23-751e-4b29-abcf-0f003adb35cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance ddc8a602-70e9-4697-b75b-c602ad4c2447 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e783c9-cf80-4419-b08a-0bb2c67d4166]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef69872d-6c40-41b7-b327-da44f126b793]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a, portal: 172.16.0.220,3260]
Apr 17 15:26:32 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:32 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff756194-f642-48c4-9dc4-afd3c8071075]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d50bc4-9580-4bc8-891f-812a64ee6804]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)
Apr 17 15:26:32 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc80fc-11f9-4b54-ab3e-3429ffac9105]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjBFoMiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] No BDM found with device name sda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] No BDM found with device name sdc, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] No VIF found with MAC fa:16:3e:dc:73:ba, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:26:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-de849bf8-d9df-401e-9b04-0eb5d5f7d726 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.152s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG os_brick.utils [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[74872b2f-1fe9-4e2f-a45b-493ad9e979ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[410dbd69-2596-4e42-a90b-2cb1a1205d88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef17880-9cab-456a-9cf3-61253d243ea7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c66d10-8dd1-401b-a399-83e329f871e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:33 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1f4513-106c-4a6a-bc49-f64498347c8b]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG os_brick.utils [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:33 user nova-compute[82617]: INFO nova.compute.manager [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Swapping volume 66000c93-eb12-4c23-8a69-71e1aa6b521f for 485ea70c-618d-4373-a78f-a460914fc095
Apr 17 15:26:33 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] <== connect_volume: return (2034ms) {'type': 'block', 'scsi_wwn': '26336303633356264', 'path': '/dev/sdh'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336303633356264', 'path': '/dev/sdh'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG nova.objects.instance [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'flavor' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 15:26:33 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:33 user nova-compute[82617]:   <source dev="/dev/sdh"/>
Apr 17 15:26:33 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:26:33 user nova-compute[82617]:   <serial>3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a</serial>
Apr 17 15:26:33 user nova-compute[82617]: </disk>
Apr 17 15:26:33 user nova-compute[82617]:  {{(pid=82617) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No BDM found with device name hda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:26:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] No VIF found with MAC fa:16:3e:cb:da:dc, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-fd4f584b-d59b-4452-9b9d-4c5ce060bfcd tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.763s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:34 user nova-compute[82617]: INFO nova.compute.manager [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Detaching volume bf63d38e-00b8-46cb-acce-fda3fd9b6a9f
Apr 17 15:26:34 user nova-compute[82617]: INFO nova.virt.block_device [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Attempting to driver detach volume bf63d38e-00b8-46cb-acce-fda3fd9b6a9f from mountpoint /dev/sdc
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Attempting to detach device sdc from instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d from the persistent domain config. {{(pid=82617) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:26:34 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:34 user nova-compute[82617]:   <source dev="/dev/sdf"/>
Apr 17 15:26:34 user nova-compute[82617]:   <target dev="sdc" bus="scsi"/>
Apr 17 15:26:34 user nova-compute[82617]:   <serial>bf63d38e-00b8-46cb-acce-fda3fd9b6a9f</serial>
Apr 17 15:26:34 user nova-compute[82617]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 17 15:26:34 user nova-compute[82617]: </disk>
Apr 17 15:26:34 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:26:34 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Successfully detached device sdc from instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d from the persistent domain config.
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d from the live domain config. {{(pid=82617) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:26:34 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:34 user nova-compute[82617]:   <source dev="/dev/sdf"/>
Apr 17 15:26:34 user nova-compute[82617]:   <target dev="sdc" bus="scsi"/>
Apr 17 15:26:34 user nova-compute[82617]:   <serial>bf63d38e-00b8-46cb-acce-fda3fd9b6a9f</serial>
Apr 17 15:26:34 user nova-compute[82617]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 17 15:26:34 user nova-compute[82617]: </disk>
Apr 17 15:26:34 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Received event <DeviceRemovedEvent: 1681745194.5146015, 3456d072-ae41-4bd2-bd5d-3622a9a5a23d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82617) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d {{(pid=82617) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 15:26:34 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Successfully detached device sdc from instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d from the live domain config.
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSVisnfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:34 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d1c67-cf7a-45a7-901d-cbb300de0165]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:26:34 user nova-compute[82617]: No targets found.
Apr 17 15:26:34 user nova-compute[82617]: iSNS:
Apr 17 15:26:34 user nova-compute[82617]: No targets found.
Apr 17 15:26:34 user nova-compute[82617]: STATIC:
Apr 17 15:26:34 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f
Apr 17 15:26:34 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:34 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:34 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310
Apr 17 15:26:34 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:34 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:34 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f
Apr 17 15:26:34 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:34 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:34 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f
Apr 17 15:26:34 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:34 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:34 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a
Apr 17 15:26:34 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:34 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:34 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:26:34 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:34 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:34 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c
Apr 17 15:26:34 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:34 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:34 user nova-compute[82617]: FIRMWARE:
Apr 17 15:26:34 user nova-compute[82617]: No targets found.
Apr 17 15:26:34 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:26:34 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:26:34 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa79feaa-17ec-4a2d-825c-097959408ede]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[51330978-dd2b-48f1-9862-e5735392a658]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)
Apr 17 15:26:34 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:34 user nova-compute[82617]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f (non-flash)
Apr 17 15:26:34 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6482fb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f'): ({'sdf'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Removing single pathed devices sdf {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8823d-6f32-4b34-967d-e57ad681b5a7]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cd8ab5-ea76-452d-9590-140bdc8048c2]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Flushing IO for device /dev/sdf {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8519387-be61-45c5-8b07-148f853d19a1]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[233c8a89-a814-4223-a6e6-d4c52e225a82]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] SCSI volumes sdf have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd0c30-1ff7-4c7c-b74b-d988d5e8eaca]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a99dd1-301a-4eea-b97e-5ccfac1364c7]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f, portal: 172.16.0.220,3260]
Apr 17 15:26:34 user nova-compute[82617]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:34 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf63d38e-00b8-46cb-acce-fda3fd9b6a9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f297cbe-7bf1-41e9-a71a-d18879c88f0e]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] <== disconnect_volume: return (363ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:35 user nova-compute[82617]: INFO nova.compute.manager [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Detaching volume 3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a
Apr 17 15:26:35 user nova-compute[82617]: INFO nova.virt.block_device [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Attempting to driver detach volume 3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a from mountpoint /dev/vdb
Apr 17 15:26:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Attempting to detach device vdb from instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c from the persistent domain config. {{(pid=82617) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:26:35 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:35 user nova-compute[82617]:   <source dev="/dev/sdh"/>
Apr 17 15:26:35 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:26:35 user nova-compute[82617]:   <serial>3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a</serial>
Apr 17 15:26:35 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 17 15:26:35 user nova-compute[82617]: </disk>
Apr 17 15:26:35 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:26:35 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Successfully detached device vdb from instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c from the persistent domain config.
Apr 17 15:26:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c from the live domain config. {{(pid=82617) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:26:35 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:26:35 user nova-compute[82617]:   <source dev="/dev/sdh"/>
Apr 17 15:26:35 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:26:35 user nova-compute[82617]:   <serial>3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a</serial>
Apr 17 15:26:35 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 17 15:26:35 user nova-compute[82617]: </disk>
Apr 17 15:26:35 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Received event <DeviceRemovedEvent: 1681745195.8388038, c1fafed5-dcf8-4bac-8b38-f2067e47bd1c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82617) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 15:26:35 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Successfully detached device vdb from instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c from the live domain config.
Apr 17 15:26:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjBFoMiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:35 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9154fe29-acf5-47f4-a9f7-d373dc401b2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:26:35 user nova-compute[82617]: No targets found.
Apr 17 15:26:35 user nova-compute[82617]: iSNS:
Apr 17 15:26:35 user nova-compute[82617]: No targets found.
Apr 17 15:26:35 user nova-compute[82617]: STATIC:
Apr 17 15:26:35 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310
Apr 17 15:26:35 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:35 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:35 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f
Apr 17 15:26:35 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:35 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:35 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f
Apr 17 15:26:35 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:35 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:35 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a
Apr 17 15:26:35 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:35 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:35 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:26:35 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:35 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:35 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c
Apr 17 15:26:35 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:35 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:35 user nova-compute[82617]: FIRMWARE:
Apr 17 15:26:35 user nova-compute[82617]: No targets found.
Apr 17 15:26:35 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:26:35 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:26:35 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a5b2e0-1b79-4ca9-a0ef-d13ea52f0f7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9281e5bb-0583-4f3b-b40a-29ed6033db72]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:35 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:35 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:35 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6482fb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a'): ({'sdh'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Removing single pathed devices sdh {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.042s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6aeacd-716d-4f95-9dc6-0882d0c0eb47]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[be26ecb9-7ce6-42e2-96e5-b39e614ba5f1]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Flushing IO for device /dev/sdh {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4560cce7-aee1-4fa8-aeca-f8cc20ccd2c9]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1452e8-07a9-4381-a29d-85caf813cdfd]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] SCSI volumes sdh have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e6091-d67c-4dbe-a3ed-c6cb6b4bb7f7]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[56024d49-0251-421a-8a14-cd68ce20cfcf]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a, portal: 172.16.0.220,3260]
Apr 17 15:26:36 user nova-compute[82617]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:36 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da98810-2c2b-49c3-a111-6b5f2b369a7e]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] <== disconnect_volume: return (335ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.objects.instance [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'flavor' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8aa52899-63af-4722-b9ff-f7493ed0a17e tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.039s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "interface-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-2e6247a6-c703-45d5-8e58-f29ff870b3a4" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "interface-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-2e6247a6-c703-45d5-8e58-f29ff870b3a4" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.objects.instance [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'flavor' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1823140976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1823140976',id=8,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUfHnESoVXPXi9ptdNvQZ84Ee9hbXkk0ExtIQFN0+4bRf8Gw1SKqE0OkJ3a+urW6oJfBopuykh0VzTN212r/3wGIPauF1zsICIzN843Fa+vOY9Vmjx0m4DGpvIcKrqkuQ==',key_name='tempest-keypair-201206862',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dfa73323c3c4c689f4012505d8b4833',ramdisk_id='',reservation_id='r-f1zz6xdu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1309189231',owner_user_name='tempest-TaggedAttachmentsTest-1309189231-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f081ecb75ec14053b68d74cacf61c802',uuid=c1fafed5-dcf8-4bac-8b38-f2067e47bd1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converting VIF {"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:59:cf,bridge_name='br-int',has_traffic_filtering=True,id=2e6247a6-c703-45d5-8e58-f29ff870b3a4,network=Network(b29112be-2108-4b35-8d7f-58985a18b6e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6247a6-c7') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ba:59:cf"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e6247a6-c7"/></interface> {{(pid=82617) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ba:59:cf"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e6247a6-c7"/></interface> {{(pid=82617) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Attempting to detach device tap2e6247a6-c7 from instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c from the persistent domain config. {{(pid=82617) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] detach device xml: <interface type="ethernet">
Apr 17 15:26:37 user nova-compute[82617]:   <mac address="fa:16:3e:ba:59:cf"/>
Apr 17 15:26:37 user nova-compute[82617]:   <model type="virtio"/>
Apr 17 15:26:37 user nova-compute[82617]:   <mtu size="1442"/>
Apr 17 15:26:37 user nova-compute[82617]:   <target dev="tap2e6247a6-c7"/>
Apr 17 15:26:37 user nova-compute[82617]: </interface>
Apr 17 15:26:37 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ba:59:cf"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e6247a6-c7"/></interface> {{(pid=82617) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ba:59:cf"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e6247a6-c7"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 17 15:26:37 user nova-compute[82617]:   <name>instance-00000008</name>
Apr 17 15:26:37 user nova-compute[82617]:   <uuid>c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</uuid>
Apr 17 15:26:37 user nova-compute[82617]:   <metadata>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:26:37 user nova-compute[82617]:   <nova:package version="0.0.0"/>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:name>tempest-device-tagging-server-1823140976</nova:name>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:creationTime>2023-04-17 15:26:18</nova:creationTime>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:flavor name="m1.nano">
Apr 17 15:26:37 user nova-compute[82617]:     <nova:memory>128</nova:memory>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:disk>1</nova:disk>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:swap>0</nova:swap>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:vcpus>1</nova:vcpus>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:flavor>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:owner>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:user uuid="f081ecb75ec14053b68d74cacf61c802">tempest-TaggedAttachmentsTest-1309189231-project-member</nova:user>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:project uuid="9dfa73323c3c4c689f4012505d8b4833">tempest-TaggedAttachmentsTest-1309189231</nova:project>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:owner>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:ports>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:port uuid="d1c7ec7e-3825-4422-ae8b-82505961b10d">
Apr 17 15:26:37 user nova-compute[82617]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 15:26:37 user nova-compute[82617]:     </nova:port>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:port uuid="2e6247a6-c703-45d5-8e58-f29ff870b3a4">
Apr 17 15:26:37 user nova-compute[82617]:       <nova:ip type="fixed" address="10.10.10.157" ipVersion="4"/>
Apr 17 15:26:37 user nova-compute[82617]:     </nova:port>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:ports>
Apr 17 15:26:37 user nova-compute[82617]: </nova:instance>
Apr 17 15:26:37 user nova-compute[82617]:   </metadata>
Apr 17 15:26:37 user nova-compute[82617]:   <memory unit='KiB'>131072</memory>
Apr 17 15:26:37 user nova-compute[82617]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 17 15:26:37 user nova-compute[82617]:   <vcpu placement='static'>1</vcpu>
Apr 17 15:26:37 user nova-compute[82617]:   <resource>
Apr 17 15:26:37 user nova-compute[82617]:     <partition>/machine</partition>
Apr 17 15:26:37 user nova-compute[82617]:   </resource>
Apr 17 15:26:37 user nova-compute[82617]:   <sysinfo type='smbios'>
Apr 17 15:26:37 user nova-compute[82617]:     <system>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='product'>OpenStack Nova</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='version'>0.0.0</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='serial'>c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='uuid'>c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='family'>Virtual Machine</entry>
Apr 17 15:26:37 user nova-compute[82617]:     </system>
Apr 17 15:26:37 user nova-compute[82617]:   </sysinfo>
Apr 17 15:26:37 user nova-compute[82617]:   <os>
Apr 17 15:26:37 user nova-compute[82617]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 17 15:26:37 user nova-compute[82617]:     <boot dev='hd'/>
Apr 17 15:26:37 user nova-compute[82617]:     <smbios mode='sysinfo'/>
Apr 17 15:26:37 user nova-compute[82617]:   </os>
Apr 17 15:26:37 user nova-compute[82617]:   <features>
Apr 17 15:26:37 user nova-compute[82617]:     <acpi/>
Apr 17 15:26:37 user nova-compute[82617]:     <apic/>
Apr 17 15:26:37 user nova-compute[82617]:     <vmcoreinfo state='on'/>
Apr 17 15:26:37 user nova-compute[82617]:   </features>
Apr 17 15:26:37 user nova-compute[82617]:   <cpu mode='custom' match='exact' check='full'>
Apr 17 15:26:37 user nova-compute[82617]:     <model fallback='forbid'>Nehalem</model>
Apr 17 15:26:37 user nova-compute[82617]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 17 15:26:37 user nova-compute[82617]:     <feature policy='require' name='vme'/>
Apr 17 15:26:37 user nova-compute[82617]:     <feature policy='require' name='x2apic'/>
Apr 17 15:26:37 user nova-compute[82617]:     <feature policy='require' name='hypervisor'/>
Apr 17 15:26:37 user nova-compute[82617]:   </cpu>
Apr 17 15:26:37 user nova-compute[82617]:   <clock offset='utc'>
Apr 17 15:26:37 user nova-compute[82617]:     <timer name='pit' tickpolicy='delay'/>
Apr 17 15:26:37 user nova-compute[82617]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 17 15:26:37 user nova-compute[82617]:     <timer name='hpet' present='no'/>
Apr 17 15:26:37 user nova-compute[82617]:   </clock>
Apr 17 15:26:37 user nova-compute[82617]:   <on_poweroff>destroy</on_poweroff>
Apr 17 15:26:37 user nova-compute[82617]:   <on_reboot>restart</on_reboot>
Apr 17 15:26:37 user nova-compute[82617]:   <on_crash>destroy</on_crash>
Apr 17 15:26:37 user nova-compute[82617]:   <devices>
Apr 17 15:26:37 user nova-compute[82617]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 15:26:37 user nova-compute[82617]:     <disk type='file' device='disk'>
Apr 17 15:26:37 user nova-compute[82617]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 17 15:26:37 user nova-compute[82617]:       <source file='/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk' index='2'/>
Apr 17 15:26:37 user nova-compute[82617]:       <backingStore type='file' index='3'>
Apr 17 15:26:37 user nova-compute[82617]:         <format type='raw'/>
Apr 17 15:26:37 user nova-compute[82617]:         <source file='/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832'/>
Apr 17 15:26:37 user nova-compute[82617]:         <backingStore/>
Apr 17 15:26:37 user nova-compute[82617]:       </backingStore>
Apr 17 15:26:37 user nova-compute[82617]:       <target dev='vda' bus='virtio'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='virtio-disk0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </disk>
Apr 17 15:26:37 user nova-compute[82617]:     <disk type='file' device='cdrom'>
Apr 17 15:26:37 user nova-compute[82617]:       <driver name='qemu' type='raw' cache='none'/>
Apr 17 15:26:37 user nova-compute[82617]:       <source file='/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.config' index='1'/>
Apr 17 15:26:37 user nova-compute[82617]:       <backingStore/>
Apr 17 15:26:37 user nova-compute[82617]:       <target dev='hda' bus='ide'/>
Apr 17 15:26:37 user nova-compute[82617]:       <readonly/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='ide0-0-0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </disk>
Apr 17 15:26:37 user nova-compute[82617]:     <controller type='usb' index='0' model='none'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='usb'/>
Apr 17 15:26:37 user nova-compute[82617]:     </controller>
Apr 17 15:26:37 user nova-compute[82617]:     <controller type='pci' index='0' model='pci-root'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='pci.0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </controller>
Apr 17 15:26:37 user nova-compute[82617]:     <controller type='ide' index='0'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='ide'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 17 15:26:37 user nova-compute[82617]:     </controller>
Apr 17 15:26:37 user nova-compute[82617]:     <interface type='ethernet'>
Apr 17 15:26:37 user nova-compute[82617]:       <mac address='fa:16:3e:cb:da:dc'/>
Apr 17 15:26:37 user nova-compute[82617]:       <target dev='tapd1c7ec7e-38'/>
Apr 17 15:26:37 user nova-compute[82617]:       <model type='virtio'/>
Apr 17 15:26:37 user nova-compute[82617]:       <mtu size='1442'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='net0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </interface>
Apr 17 15:26:37 user nova-compute[82617]:     <interface type='ethernet'>
Apr 17 15:26:37 user nova-compute[82617]:       <mac address='fa:16:3e:ba:59:cf'/>
Apr 17 15:26:37 user nova-compute[82617]:       <target dev='tap2e6247a6-c7'/>
Apr 17 15:26:37 user nova-compute[82617]:       <model type='virtio'/>
Apr 17 15:26:37 user nova-compute[82617]:       <mtu size='1442'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='net1'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </interface>
Apr 17 15:26:37 user nova-compute[82617]:     <serial type='pty'>
Apr 17 15:26:37 user nova-compute[82617]:       <source path='/dev/pts/7'/>
Apr 17 15:26:37 user nova-compute[82617]:       <log file='/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/console.log' append='off'/>
Apr 17 15:26:37 user nova-compute[82617]:       <target type='isa-serial' port='0'>
Apr 17 15:26:37 user nova-compute[82617]:         <model name='isa-serial'/>
Apr 17 15:26:37 user nova-compute[82617]:       </target>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='serial0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </serial>
Apr 17 15:26:37 user nova-compute[82617]:     <console type='pty' tty='/dev/pts/7'>
Apr 17 15:26:37 user nova-compute[82617]:       <source path='/dev/pts/7'/>
Apr 17 15:26:37 user nova-compute[82617]:       <log file='/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/console.log' append='off'/>
Apr 17 15:26:37 user nova-compute[82617]:       <target type='serial' port='0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='serial0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </console>
Apr 17 15:26:37 user nova-compute[82617]:     <input type='mouse' bus='ps2'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='input0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </input>
Apr 17 15:26:37 user nova-compute[82617]:     <input type='keyboard' bus='ps2'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='input1'/>
Apr 17 15:26:37 user nova-compute[82617]:     </input>
Apr 17 15:26:37 user nova-compute[82617]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 17 15:26:37 user nova-compute[82617]:       <listen type='address' address='0.0.0.0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </graphics>
Apr 17 15:26:37 user nova-compute[82617]:     <audio id='1' type='none'/>
Apr 17 15:26:37 user nova-compute[82617]:     <video>
Apr 17 15:26:37 user nova-compute[82617]:       <model type='virtio' heads='1' primary='yes'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='video0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </video>
Apr 17 15:26:37 user nova-compute[82617]:     <memballoon model='virtio'>
Apr 17 15:26:37 user nova-compute[82617]:       <stats period='10'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='balloon0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </memballoon>
Apr 17 15:26:37 user nova-compute[82617]:     <rng model='virtio'>
Apr 17 15:26:37 user nova-compute[82617]:       <backend model='random'>/dev/urandom</backend>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='rng0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </rng>
Apr 17 15:26:37 user nova-compute[82617]:   </devices>
Apr 17 15:26:37 user nova-compute[82617]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 17 15:26:37 user nova-compute[82617]:     <label>libvirt-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</label>
Apr 17 15:26:37 user nova-compute[82617]:     <imagelabel>libvirt-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</imagelabel>
Apr 17 15:26:37 user nova-compute[82617]:   </seclabel>
Apr 17 15:26:37 user nova-compute[82617]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 17 15:26:37 user nova-compute[82617]:     <label>+64055:+108</label>
Apr 17 15:26:37 user nova-compute[82617]:     <imagelabel>+64055:+108</imagelabel>
Apr 17 15:26:37 user nova-compute[82617]:   </seclabel>
Apr 17 15:26:37 user nova-compute[82617]: </domain>
Apr 17 15:26:37 user nova-compute[82617]:  {{(pid=82617) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 17 15:26:37 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Successfully detached device tap2e6247a6-c7 from instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c from the persistent domain config.
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] (1/8): Attempting to detach device tap2e6247a6-c7 with device alias net1 from instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c from the live domain config. {{(pid=82617) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] detach device xml: <interface type="ethernet">
Apr 17 15:26:37 user nova-compute[82617]:   <mac address="fa:16:3e:ba:59:cf"/>
Apr 17 15:26:37 user nova-compute[82617]:   <model type="virtio"/>
Apr 17 15:26:37 user nova-compute[82617]:   <mtu size="1442"/>
Apr 17 15:26:37 user nova-compute[82617]:   <target dev="tap2e6247a6-c7"/>
Apr 17 15:26:37 user nova-compute[82617]: </interface>
Apr 17 15:26:37 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Received event <DeviceRemovedEvent: 1681745197.7298338, c1fafed5-dcf8-4bac-8b38-f2067e47bd1c => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82617) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Start waiting for the detach event from libvirt for device tap2e6247a6-c7 with device alias net1 for instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ba:59:cf"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e6247a6-c7"/></interface> {{(pid=82617) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ba:59:cf"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e6247a6-c7"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 17 15:26:37 user nova-compute[82617]:   <name>instance-00000008</name>
Apr 17 15:26:37 user nova-compute[82617]:   <uuid>c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</uuid>
Apr 17 15:26:37 user nova-compute[82617]:   <metadata>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:26:37 user nova-compute[82617]:   <nova:package version="0.0.0"/>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:name>tempest-device-tagging-server-1823140976</nova:name>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:creationTime>2023-04-17 15:26:18</nova:creationTime>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:flavor name="m1.nano">
Apr 17 15:26:37 user nova-compute[82617]:     <nova:memory>128</nova:memory>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:disk>1</nova:disk>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:swap>0</nova:swap>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:vcpus>1</nova:vcpus>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:flavor>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:owner>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:user uuid="f081ecb75ec14053b68d74cacf61c802">tempest-TaggedAttachmentsTest-1309189231-project-member</nova:user>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:project uuid="9dfa73323c3c4c689f4012505d8b4833">tempest-TaggedAttachmentsTest-1309189231</nova:project>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:owner>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:ports>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:port uuid="d1c7ec7e-3825-4422-ae8b-82505961b10d">
Apr 17 15:26:37 user nova-compute[82617]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 15:26:37 user nova-compute[82617]:     </nova:port>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:port uuid="2e6247a6-c703-45d5-8e58-f29ff870b3a4">
Apr 17 15:26:37 user nova-compute[82617]:       <nova:ip type="fixed" address="10.10.10.157" ipVersion="4"/>
Apr 17 15:26:37 user nova-compute[82617]:     </nova:port>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:ports>
Apr 17 15:26:37 user nova-compute[82617]: </nova:instance>
Apr 17 15:26:37 user nova-compute[82617]:   </metadata>
Apr 17 15:26:37 user nova-compute[82617]:   <memory unit='KiB'>131072</memory>
Apr 17 15:26:37 user nova-compute[82617]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 17 15:26:37 user nova-compute[82617]:   <vcpu placement='static'>1</vcpu>
Apr 17 15:26:37 user nova-compute[82617]:   <resource>
Apr 17 15:26:37 user nova-compute[82617]:     <partition>/machine</partition>
Apr 17 15:26:37 user nova-compute[82617]:   </resource>
Apr 17 15:26:37 user nova-compute[82617]:   <sysinfo type='smbios'>
Apr 17 15:26:37 user nova-compute[82617]:     <system>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='product'>OpenStack Nova</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='version'>0.0.0</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='serial'>c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='uuid'>c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</entry>
Apr 17 15:26:37 user nova-compute[82617]:       <entry name='family'>Virtual Machine</entry>
Apr 17 15:26:37 user nova-compute[82617]:     </system>
Apr 17 15:26:37 user nova-compute[82617]:   </sysinfo>
Apr 17 15:26:37 user nova-compute[82617]:   <os>
Apr 17 15:26:37 user nova-compute[82617]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 17 15:26:37 user nova-compute[82617]:     <boot dev='hd'/>
Apr 17 15:26:37 user nova-compute[82617]:     <smbios mode='sysinfo'/>
Apr 17 15:26:37 user nova-compute[82617]:   </os>
Apr 17 15:26:37 user nova-compute[82617]:   <features>
Apr 17 15:26:37 user nova-compute[82617]:     <acpi/>
Apr 17 15:26:37 user nova-compute[82617]:     <apic/>
Apr 17 15:26:37 user nova-compute[82617]:     <vmcoreinfo state='on'/>
Apr 17 15:26:37 user nova-compute[82617]:   </features>
Apr 17 15:26:37 user nova-compute[82617]:   <cpu mode='custom' match='exact' check='full'>
Apr 17 15:26:37 user nova-compute[82617]:     <model fallback='forbid'>Nehalem</model>
Apr 17 15:26:37 user nova-compute[82617]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 17 15:26:37 user nova-compute[82617]:     <feature policy='require' name='vme'/>
Apr 17 15:26:37 user nova-compute[82617]:     <feature policy='require' name='x2apic'/>
Apr 17 15:26:37 user nova-compute[82617]:     <feature policy='require' name='hypervisor'/>
Apr 17 15:26:37 user nova-compute[82617]:   </cpu>
Apr 17 15:26:37 user nova-compute[82617]:   <clock offset='utc'>
Apr 17 15:26:37 user nova-compute[82617]:     <timer name='pit' tickpolicy='delay'/>
Apr 17 15:26:37 user nova-compute[82617]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 17 15:26:37 user nova-compute[82617]:     <timer name='hpet' present='no'/>
Apr 17 15:26:37 user nova-compute[82617]:   </clock>
Apr 17 15:26:37 user nova-compute[82617]:   <on_poweroff>destroy</on_poweroff>
Apr 17 15:26:37 user nova-compute[82617]:   <on_reboot>restart</on_reboot>
Apr 17 15:26:37 user nova-compute[82617]:   <on_crash>destroy</on_crash>
Apr 17 15:26:37 user nova-compute[82617]:   <devices>
Apr 17 15:26:37 user nova-compute[82617]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 15:26:37 user nova-compute[82617]:     <disk type='file' device='disk'>
Apr 17 15:26:37 user nova-compute[82617]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 17 15:26:37 user nova-compute[82617]:       <source file='/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk' index='2'/>
Apr 17 15:26:37 user nova-compute[82617]:       <backingStore type='file' index='3'>
Apr 17 15:26:37 user nova-compute[82617]:         <format type='raw'/>
Apr 17 15:26:37 user nova-compute[82617]:         <source file='/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832'/>
Apr 17 15:26:37 user nova-compute[82617]:         <backingStore/>
Apr 17 15:26:37 user nova-compute[82617]:       </backingStore>
Apr 17 15:26:37 user nova-compute[82617]:       <target dev='vda' bus='virtio'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='virtio-disk0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </disk>
Apr 17 15:26:37 user nova-compute[82617]:     <disk type='file' device='cdrom'>
Apr 17 15:26:37 user nova-compute[82617]:       <driver name='qemu' type='raw' cache='none'/>
Apr 17 15:26:37 user nova-compute[82617]:       <source file='/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/disk.config' index='1'/>
Apr 17 15:26:37 user nova-compute[82617]:       <backingStore/>
Apr 17 15:26:37 user nova-compute[82617]:       <target dev='hda' bus='ide'/>
Apr 17 15:26:37 user nova-compute[82617]:       <readonly/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='ide0-0-0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </disk>
Apr 17 15:26:37 user nova-compute[82617]:     <controller type='usb' index='0' model='none'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='usb'/>
Apr 17 15:26:37 user nova-compute[82617]:     </controller>
Apr 17 15:26:37 user nova-compute[82617]:     <controller type='pci' index='0' model='pci-root'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='pci.0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </controller>
Apr 17 15:26:37 user nova-compute[82617]:     <controller type='ide' index='0'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='ide'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 17 15:26:37 user nova-compute[82617]:     </controller>
Apr 17 15:26:37 user nova-compute[82617]:     <interface type='ethernet'>
Apr 17 15:26:37 user nova-compute[82617]:       <mac address='fa:16:3e:cb:da:dc'/>
Apr 17 15:26:37 user nova-compute[82617]:       <target dev='tapd1c7ec7e-38'/>
Apr 17 15:26:37 user nova-compute[82617]:       <model type='virtio'/>
Apr 17 15:26:37 user nova-compute[82617]:       <mtu size='1442'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='net0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </interface>
Apr 17 15:26:37 user nova-compute[82617]:     <serial type='pty'>
Apr 17 15:26:37 user nova-compute[82617]:       <source path='/dev/pts/7'/>
Apr 17 15:26:37 user nova-compute[82617]:       <log file='/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/console.log' append='off'/>
Apr 17 15:26:37 user nova-compute[82617]:       <target type='isa-serial' port='0'>
Apr 17 15:26:37 user nova-compute[82617]:         <model name='isa-serial'/>
Apr 17 15:26:37 user nova-compute[82617]:       </target>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='serial0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </serial>
Apr 17 15:26:37 user nova-compute[82617]:     <console type='pty' tty='/dev/pts/7'>
Apr 17 15:26:37 user nova-compute[82617]:       <source path='/dev/pts/7'/>
Apr 17 15:26:37 user nova-compute[82617]:       <log file='/opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c/console.log' append='off'/>
Apr 17 15:26:37 user nova-compute[82617]:       <target type='serial' port='0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='serial0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </console>
Apr 17 15:26:37 user nova-compute[82617]:     <input type='mouse' bus='ps2'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='input0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </input>
Apr 17 15:26:37 user nova-compute[82617]:     <input type='keyboard' bus='ps2'>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='input1'/>
Apr 17 15:26:37 user nova-compute[82617]:     </input>
Apr 17 15:26:37 user nova-compute[82617]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 17 15:26:37 user nova-compute[82617]:       <listen type='address' address='0.0.0.0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </graphics>
Apr 17 15:26:37 user nova-compute[82617]:     <audio id='1' type='none'/>
Apr 17 15:26:37 user nova-compute[82617]:     <video>
Apr 17 15:26:37 user nova-compute[82617]:       <model type='virtio' heads='1' primary='yes'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='video0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </video>
Apr 17 15:26:37 user nova-compute[82617]:     <memballoon model='virtio'>
Apr 17 15:26:37 user nova-compute[82617]:       <stats period='10'/>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='balloon0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </memballoon>
Apr 17 15:26:37 user nova-compute[82617]:     <rng model='virtio'>
Apr 17 15:26:37 user nova-compute[82617]:       <backend model='random'>/dev/urandom</backend>
Apr 17 15:26:37 user nova-compute[82617]:       <alias name='rng0'/>
Apr 17 15:26:37 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 17 15:26:37 user nova-compute[82617]:     </rng>
Apr 17 15:26:37 user nova-compute[82617]:   </devices>
Apr 17 15:26:37 user nova-compute[82617]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 17 15:26:37 user nova-compute[82617]:     <label>libvirt-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</label>
Apr 17 15:26:37 user nova-compute[82617]:     <imagelabel>libvirt-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c</imagelabel>
Apr 17 15:26:37 user nova-compute[82617]:   </seclabel>
Apr 17 15:26:37 user nova-compute[82617]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 17 15:26:37 user nova-compute[82617]:     <label>+64055:+108</label>
Apr 17 15:26:37 user nova-compute[82617]:     <imagelabel>+64055:+108</imagelabel>
Apr 17 15:26:37 user nova-compute[82617]:   </seclabel>
Apr 17 15:26:37 user nova-compute[82617]: </domain>
Apr 17 15:26:37 user nova-compute[82617]:  {{(pid=82617) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 17 15:26:37 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Successfully detached device tap2e6247a6-c7 from instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c from the live domain config.
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1823140976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1823140976',id=8,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUfHnESoVXPXi9ptdNvQZ84Ee9hbXkk0ExtIQFN0+4bRf8Gw1SKqE0OkJ3a+urW6oJfBopuykh0VzTN212r/3wGIPauF1zsICIzN843Fa+vOY9Vmjx0m4DGpvIcKrqkuQ==',key_name='tempest-keypair-201206862',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dfa73323c3c4c689f4012505d8b4833',ramdisk_id='',reservation_id='r-f1zz6xdu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1309189231',owner_user_name='tempest-TaggedAttachmentsTest-1309189231-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f081ecb75ec14053b68d74cacf61c802',uuid=c1fafed5-dcf8-4bac-8b38-f2067e47bd1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converting VIF {"id": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "address": "fa:16:3e:ba:59:cf", "network": {"id": "b29112be-2108-4b35-8d7f-58985a18b6e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1561517040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6247a6-c7", "ovs_interfaceid": "2e6247a6-c703-45d5-8e58-f29ff870b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:59:cf,bridge_name='br-int',has_traffic_filtering=True,id=2e6247a6-c703-45d5-8e58-f29ff870b3a4,network=Network(b29112be-2108-4b35-8d7f-58985a18b6e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6247a6-c7') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG os_vif [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:59:cf,bridge_name='br-int',has_traffic_filtering=True,id=2e6247a6-c703-45d5-8e58-f29ff870b3a4,network=Network(b29112be-2108-4b35-8d7f-58985a18b6e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6247a6-c7') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e6247a6-c7, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:37 user nova-compute[82617]: INFO os_vif [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:59:cf,bridge_name='br-int',has_traffic_filtering=True,id=2e6247a6-c703-45d5-8e58-f29ff870b3a4,network=Network(b29112be-2108-4b35-8d7f-58985a18b6e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6247a6-c7')
Apr 17 15:26:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:26:37 user nova-compute[82617]:   <nova:package version="0.0.0"/>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:name>tempest-device-tagging-server-1823140976</nova:name>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:creationTime>2023-04-17 15:26:37</nova:creationTime>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:flavor name="m1.nano">
Apr 17 15:26:37 user nova-compute[82617]:     <nova:memory>128</nova:memory>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:disk>1</nova:disk>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:swap>0</nova:swap>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:vcpus>1</nova:vcpus>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:flavor>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:owner>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:user uuid="f081ecb75ec14053b68d74cacf61c802">tempest-TaggedAttachmentsTest-1309189231-project-member</nova:user>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:project uuid="9dfa73323c3c4c689f4012505d8b4833">tempest-TaggedAttachmentsTest-1309189231</nova:project>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:owner>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:26:37 user nova-compute[82617]:   <nova:ports>
Apr 17 15:26:37 user nova-compute[82617]:     <nova:port uuid="d1c7ec7e-3825-4422-ae8b-82505961b10d">
Apr 17 15:26:37 user nova-compute[82617]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 17 15:26:37 user nova-compute[82617]:     </nova:port>
Apr 17 15:26:37 user nova-compute[82617]:   </nova:ports>
Apr 17 15:26:37 user nova-compute[82617]: </nova:instance>
Apr 17 15:26:37 user nova-compute[82617]:  {{(pid=82617) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG nova.compute.manager [req-59a15a7b-58a8-4332-b68d-31d305915fba req-79d4f6f3-3951-4309-a6b3-0c4aa8b4e6df service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-unplugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-59a15a7b-58a8-4332-b68d-31d305915fba req-79d4f6f3-3951-4309-a6b3-0c4aa8b4e6df service nova] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-59a15a7b-58a8-4332-b68d-31d305915fba req-79d4f6f3-3951-4309-a6b3-0c4aa8b4e6df service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-59a15a7b-58a8-4332-b68d-31d305915fba req-79d4f6f3-3951-4309-a6b3-0c4aa8b4e6df service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG nova.compute.manager [req-59a15a7b-58a8-4332-b68d-31d305915fba req-79d4f6f3-3951-4309-a6b3-0c4aa8b4e6df service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] No waiting events found dispatching network-vif-unplugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:38 user nova-compute[82617]: WARNING nova.compute.manager [req-59a15a7b-58a8-4332-b68d-31d305915fba req-79d4f6f3-3951-4309-a6b3-0c4aa8b4e6df service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received unexpected event network-vif-unplugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 for instance with vm_state active and task_state None.
Apr 17 15:26:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquired lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:26:38 user nova-compute[82617]: DEBUG nova.objects.instance [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lazy-loading 'flavor' on Instance uuid 3456d072-ae41-4bd2-bd5d-3622a9a5a23d {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-709e8d1d-5a28-4240-8e7a-adfedc29ea50 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.010s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBubQvJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '109c9a23-751e-4b29-abcf-0f003adb35cc', 'attached_at': '', 'detached_at': '', 'volume_id': '485ea70c-618d-4373-a78f-a460914fc095', 'serial': '485ea70c-618d-4373-a78f-a460914fc095'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '109c9a23-751e-4b29-abcf-0f003adb35cc', 'attached_at': '', 'detached_at': '', 'volume_id': '66000c93-eb12-4c23-8a69-71e1aa6b521f', 'serial'} {{(pid=82617) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBubQvJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:39 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:39 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:39 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b311c-b685-49cc-841d-3c6787062261]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:26:39 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b88ec9-29b0-4ce2-9d57-d31f750e7896]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095] added
Apr 17 15:26:39 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6239c7-0636-4c52-9f28-a33e7fcf3bc3]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:39 user nova-compute[82617]: INFO nova.network.neutron [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Port 2e6247a6-c703-45d5-8e58-f29ff870b3a4 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 17 15:26:39 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating instance_info_cache with network_info: [{"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a197276a-7cc2-4890-b74c-6f970f1a0a9c]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Releasing lock "refresh_cache-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBubQvJS {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2439185e-bc6d-408d-9afe-f24d70ac1854 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "interface-c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-2e6247a6-c703-45d5-8e58-f29ff870b3a4" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.933s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBubQvJS" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4459a44e-90c5-4f5a-affe-ef175773a2c4]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBubQvJS'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5814ef6-cfc8-45a6-8eee-a885c2d70a44]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[05754774-a50c-43f3-818f-cd5c24965985]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:39 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:39 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b4a53b-4f01-46bf-9691-03fccd0492cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095, portal: 172.16.0.220,3260]
Apr 17 15:26:39 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:39 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[480f218e-c470-4aab-aeb7-5e699a382bb0]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba79a7e-7558-4055-96f9-50d0e4a6040f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:39 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:39 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:39 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[068052e0-b41a-4e9f-af1d-96065d66623e]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBubQvJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:39 user nova-compute[82617]: INFO nova.compute.manager [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Terminating instance
Apr 17 15:26:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.compute.manager [req-19425d40-722c-4ec1-a151-5bfb65e29147 req-8c6cc9a4-1b93-4bbe-a090-549ef068a4ae service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-19425d40-722c-4ec1-a151-5bfb65e29147 req-8c6cc9a4-1b93-4bbe-a090-549ef068a4ae service nova] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-19425d40-722c-4ec1-a151-5bfb65e29147 req-8c6cc9a4-1b93-4bbe-a090-549ef068a4ae service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-19425d40-722c-4ec1-a151-5bfb65e29147 req-8c6cc9a4-1b93-4bbe-a090-549ef068a4ae service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.compute.manager [req-19425d40-722c-4ec1-a151-5bfb65e29147 req-8c6cc9a4-1b93-4bbe-a090-549ef068a4ae service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] No waiting events found dispatching network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:40 user nova-compute[82617]: WARNING nova.compute.manager [req-19425d40-722c-4ec1-a151-5bfb65e29147 req-8c6cc9a4-1b93-4bbe-a090-549ef068a4ae service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received unexpected event network-vif-plugged-2e6247a6-c703-45d5-8e58-f29ff870b3a4 for instance with vm_state active and task_state None.
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.compute.manager [req-19425d40-722c-4ec1-a151-5bfb65e29147 req-8c6cc9a4-1b93-4bbe-a090-549ef068a4ae service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-deleted-2e6247a6-c703-45d5-8e58-f29ff870b3a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26231366632393535', 'path': '/dev/sdf'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231366632393535', 'path': '/dev/sdf'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lazy-loading 'flavor' on Instance uuid 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:40 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Instance destroyed successfully.
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.objects.instance [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lazy-loading 'resources' on Instance uuid 3456d072-ae41-4bd2-bd5d-3622a9a5a23d {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-353147092',display_name='tempest-AttachSCSIVolumeTestJSON-server-353147092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-353147092',id=6,image_ref='911f0f9a-e08e-404e-927e-0239328839b0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMik5YI1BskjrMfwqNYIJSXfH/EglGjrkBEzbJNkzpmFhPDGgkvsbY09Hv08wuU5IlCSf6+ruYbkEIhdfaqNbjxS5QSP3lcxK8A+eOfyf9q3S6JRSK1NK9BfOQHeJN04w==',key_name='tempest-keypair-212722224',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fd4ceec29874bc38e8da456cab2048d',ramdisk_id='',reservation_id='r-mq0ucv0z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='911f0f9a-e08e-404e-927e-0239328839b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-944917744',owner_user_name='tempest-AttachSCSIVolumeTestJSON-944917744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1734894909e44118bd60e233dc501a0',uuid=3456d072-ae41-4bd2-bd5d-3622a9a5a23d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Converting VIF {"id": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "address": "fa:16:3e:dc:73:ba", "network": {"id": "bd093d71-00e5-48a6-b9fa-db1d299a5525", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772117301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fd4ceec29874bc38e8da456cab2048d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f4c8b-76", "ovs_interfaceid": "159f4c8b-7692-4b13-8c6a-884b6ccd8964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:73:ba,bridge_name='br-int',has_traffic_filtering=True,id=159f4c8b-7692-4b13-8c6a-884b6ccd8964,network=Network(bd093d71-00e5-48a6-b9fa-db1d299a5525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f4c8b-76') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG os_vif [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:73:ba,bridge_name='br-int',has_traffic_filtering=True,id=159f4c8b-7692-4b13-8c6a-884b6ccd8964,network=Network(bd093d71-00e5-48a6-b9fa-db1d299a5525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f4c8b-76') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap159f4c8b-76, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:26:40 user nova-compute[82617]: INFO os_vif [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:73:ba,bridge_name='br-int',has_traffic_filtering=True,id=159f4c8b-7692-4b13-8c6a-884b6ccd8964,network=Network(bd093d71-00e5-48a6-b9fa-db1d299a5525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f4c8b-76')
Apr 17 15:26:40 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Deleting instance files /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d_del
Apr 17 15:26:40 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Deletion of /opt/stack/data/nova/instances/3456d072-ae41-4bd2-bd5d-3622a9a5a23d_del complete
Apr 17 15:26:40 user nova-compute[82617]: INFO nova.compute.manager [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 17 15:26:40 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:26:40 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:26:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 125829120 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:41 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:41 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Took 1.18 seconds to deallocate network for instance.
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 282066944 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.compute.manager [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received event network-vif-unplugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.compute.manager [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] No waiting events found dispatching network-vif-unplugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:42 user nova-compute[82617]: WARNING nova.compute.manager [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received unexpected event network-vif-unplugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 for instance with vm_state deleted and task_state None.
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.compute.manager [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received event network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] Acquiring lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.compute.manager [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] No waiting events found dispatching network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:42 user nova-compute[82617]: WARNING nova.compute.manager [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received unexpected event network-vif-plugged-159f4c8b-7692-4b13-8c6a-884b6ccd8964 for instance with vm_state deleted and task_state None.
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.compute.manager [req-7a33d3ec-26dc-40cb-a524-807a724a98e3 req-6f0b2e13-dac1-45ab-939d-c99f133d7f1b service nova] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Received event network-vif-deleted-159f4c8b-7692-4b13-8c6a-884b6ccd8964 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:42 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Deleted allocations for instance 3456d072-ae41-4bd2-bd5d-3622a9a5a23d
Apr 17 15:26:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 435159040 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-27e849b9-31e8-4687-a3d4-394be8d1e112 tempest-AttachSCSIVolumeTestJSON-944917744 tempest-AttachSCSIVolumeTestJSON-944917744-project-member] Lock "3456d072-ae41-4bd2-bd5d-3622a9a5a23d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:43 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 581959680 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:43 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 759169024 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:44 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 901775360 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:44 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 1060110336 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG nova.compute.manager [req-edfd4950-b223-44f3-a075-990e5890a7f4 req-108412f2-bdaa-4d8b-8c91-da7c91d4c73a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-changed-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG nova.compute.manager [req-edfd4950-b223-44f3-a075-990e5890a7f4 req-108412f2-bdaa-4d8b-8c91-da7c91d4c73a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing instance network info cache due to event network-changed-735ea25c-24c9-40de-8245-af769da97133. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-edfd4950-b223-44f3-a075-990e5890a7f4 req-108412f2-bdaa-4d8b-8c91-da7c91d4c73a service nova] Acquiring lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-edfd4950-b223-44f3-a075-990e5890a7f4 req-108412f2-bdaa-4d8b-8c91-da7c91d4c73a service nova] Acquired lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG nova.network.neutron [req-edfd4950-b223-44f3-a075-990e5890a7f4 req-108412f2-bdaa-4d8b-8c91-da7c91d4c73a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Refreshing network info cache for port 735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:45 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a26739e-cf24-447e-b2c7-fd455dbbeb04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:26:45 user nova-compute[82617]: No targets found.
Apr 17 15:26:45 user nova-compute[82617]: iSNS:
Apr 17 15:26:45 user nova-compute[82617]: No targets found.
Apr 17 15:26:45 user nova-compute[82617]: STATIC:
Apr 17 15:26:45 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310
Apr 17 15:26:45 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:45 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:45 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f
Apr 17 15:26:45 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:45 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:45 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095
Apr 17 15:26:45 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:45 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:45 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f
Apr 17 15:26:45 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:45 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:45 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:26:45 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:45 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:45 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c
Apr 17 15:26:45 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:45 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:45 user nova-compute[82617]: FIRMWARE:
Apr 17 15:26:45 user nova-compute[82617]: No targets found.
Apr 17 15:26:45 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:26:45 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:26:45 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3ed42d-07db-4a29-acfa-4dca9c83a444]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[34295e7f-eda5-46e5-b8ab-b2538639162a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:45 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:45 user nova-compute[82617]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:45 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64e7b4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f'): ({'sdg'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Removing single pathed devices sdg {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9cbd4c-5c1a-4af8-a1f3-0815be0c47f4]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e45cfa9-2338-4b86-8d93-7db03e74bdd0]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Flushing IO for device /dev/sdg {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ed3a00-f64e-4163-aaad-088056354643]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bb40e0-dcfa-40ac-b918-de52bea3abe9]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] SCSI volumes sdg have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[16340a9b-837a-4ca1-8ed8-942702acfa47]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec7f31e-3f76-4f5e-b457-c4b15264cf1c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260]
Apr 17 15:26:45 user nova-compute[82617]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:45 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93ba49c-89bf-43d1-afff-49ff871e71fa]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] <== disconnect_volume: return (335ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBubQvJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '109c9a23-751e-4b29-abcf-0f003adb35cc', 'attached_at': '', 'detached_at': '', 'volume_id': '485ea70c-618d-4373-a78f-a460914fc095', 'serial'} {{(pid=82617) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 17 15:26:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] swap_volume: removing Cinder connection for volume 66000c93-eb12-4c23-8a69-71e1aa6b521f {{(pid=82617) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 17 15:26:46 user nova-compute[82617]: DEBUG nova.network.neutron [req-edfd4950-b223-44f3-a075-990e5890a7f4 req-108412f2-bdaa-4d8b-8c91-da7c91d4c73a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updated VIF entry in instance network info cache for port 735ea25c-24c9-40de-8245-af769da97133. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:26:46 user nova-compute[82617]: DEBUG nova.network.neutron [req-edfd4950-b223-44f3-a075-990e5890a7f4 req-108412f2-bdaa-4d8b-8c91-da7c91d4c73a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [{"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] swap_volume: Updating volume 66000c93-eb12-4c23-8a69-71e1aa6b521f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WBubQvJS", "auth_password": "XBNtnWHrPfMu3U", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "485ea70c-618d-4373-a78f-a460914fc095"}, "status": "reserved", "instance": "109c9a23-751e-4b29-abcf-0f003adb35cc", "attached_at": "", "detached_at": "", "volume_id": "485ea70c-618d-4373-a78f-a460914fc095", "serial": "485ea70c-618d-4373-a78f-a460914fc095"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '485ea70c-618d-4373-a78f-a460914fc095', 'no_device': None, 'attachment_id': '9a8c6327-030a-41e4-98c6-a23b982c5ee9'} {{(pid=82617) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 17 15:26:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-edfd4950-b223-44f3-a075-990e5890a7f4 req-108412f2-bdaa-4d8b-8c91-da7c91d4c73a service nova] Releasing lock "refresh_cache-ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:26:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b239e302-6fec-456c-b14a-e56af141016e tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.491s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:47 user nova-compute[82617]: INFO nova.compute.manager [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Terminating instance
Apr 17 15:26:47 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG nova.compute.manager [req-dd88432d-2a4d-4f5f-b8c5-69e1c55530bf req-6f5ceb9f-f07f-40db-8c3c-13bfa78761c1 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-dd88432d-2a4d-4f5f-b8c5-69e1c55530bf req-6f5ceb9f-f07f-40db-8c3c-13bfa78761c1 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-dd88432d-2a4d-4f5f-b8c5-69e1c55530bf req-6f5ceb9f-f07f-40db-8c3c-13bfa78761c1 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-dd88432d-2a4d-4f5f-b8c5-69e1c55530bf req-6f5ceb9f-f07f-40db-8c3c-13bfa78761c1 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG nova.compute.manager [req-dd88432d-2a4d-4f5f-b8c5-69e1c55530bf req-6f5ceb9f-f07f-40db-8c3c-13bfa78761c1 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-unplugged-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG nova.compute.manager [req-dd88432d-2a4d-4f5f-b8c5-69e1c55530bf req-6f5ceb9f-f07f-40db-8c3c-13bfa78761c1 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-735ea25c-24c9-40de-8245-af769da97133 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.006s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG os_brick.utils [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG nova.compute.manager [req-5314ba98-a036-40d8-b400-03ceda569f8e req-86e97cd2-9198-4f6f-b3b6-d645c301cb8a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5314ba98-a036-40d8-b400-03ceda569f8e req-86e97cd2-9198-4f6f-b3b6-d645c301cb8a service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5314ba98-a036-40d8-b400-03ceda569f8e req-86e97cd2-9198-4f6f-b3b6-d645c301cb8a service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5314ba98-a036-40d8-b400-03ceda569f8e req-86e97cd2-9198-4f6f-b3b6-d645c301cb8a service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG nova.compute.manager [req-5314ba98-a036-40d8-b400-03ceda569f8e req-86e97cd2-9198-4f6f-b3b6-d645c301cb8a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-unplugged-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG nova.compute.manager [req-5314ba98-a036-40d8-b400-03ceda569f8e req-86e97cd2-9198-4f6f-b3b6-d645c301cb8a service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-a5b50853-da53-409a-9a0f-259f9f383098 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f10d66-16fd-4d81-99ad-824b4a5403a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfe2361-592a-4e49-a42b-cf6b61617ee1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[807bde5a-a4c2-4c94-87cd-a65aadd3eda8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfa5026-c5ab-469e-a026-b17942611764]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:26:48 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ca56d5-655a-4995-b8a4-a21ffe01fdf0]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG os_brick.utils [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG nova.compute.manager [req-2c01a879-7158-440a-86c2-fad7345ce134 req-a96fa1bb-24ad-423f-b370-b7890e821483 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2c01a879-7158-440a-86c2-fad7345ce134 req-a96fa1bb-24ad-423f-b370-b7890e821483 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2c01a879-7158-440a-86c2-fad7345ce134 req-a96fa1bb-24ad-423f-b370-b7890e821483 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2c01a879-7158-440a-86c2-fad7345ce134 req-a96fa1bb-24ad-423f-b370-b7890e821483 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG nova.compute.manager [req-2c01a879-7158-440a-86c2-fad7345ce134 req-a96fa1bb-24ad-423f-b370-b7890e821483 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-unplugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG nova.compute.manager [req-2c01a879-7158-440a-86c2-fad7345ce134 req-a96fa1bb-24ad-423f-b370-b7890e821483 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:26:48 user nova-compute[82617]: INFO nova.compute.manager [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Swapping volume 485ea70c-618d-4373-a78f-a460914fc095 for 66000c93-eb12-4c23-8a69-71e1aa6b521f
Apr 17 15:26:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:48 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Instance destroyed successfully.
Apr 17 15:26:48 user nova-compute[82617]: DEBUG nova.objects.instance [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lazy-loading 'resources' on Instance uuid ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "735ea25c-24c9-40de-8245-af769da97133", "address": "fa:16:3e:84:66:67", "network": {"id": "cb2880f9-1c09-4f2d-9f5a-80b58e430388", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-352605895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735ea25c-24", "ovs_interfaceid": "735ea25c-24c9-40de-8245-af769da97133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:66:67,bridge_name='br-int',has_traffic_filtering=True,id=735ea25c-24c9-40de-8245-af769da97133,network=Network(cb2880f9-1c09-4f2d-9f5a-80b58e430388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735ea25c-24') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:66:67,bridge_name='br-int',has_traffic_filtering=True,id=735ea25c-24c9-40de-8245-af769da97133,network=Network(cb2880f9-1c09-4f2d-9f5a-80b58e430388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735ea25c-24') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap735ea25c-24, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: INFO os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:66:67,bridge_name='br-int',has_traffic_filtering=True,id=735ea25c-24c9-40de-8245-af769da97133,network=Network(cb2880f9-1c09-4f2d-9f5a-80b58e430388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735ea25c-24')
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=eed93fad-9763-444d-8483-d4eaeaad3e77,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed93fad-97') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=eed93fad-9763-444d-8483-d4eaeaad3e77,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed93fad-97') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeed93fad-97, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: INFO os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=eed93fad-9763-444d-8483-d4eaeaad3e77,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed93fad-97')
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=a5b50853-da53-409a-9a0f-259f9f383098,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5b50853-da') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=a5b50853-da53-409a-9a0f-259f9f383098,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5b50853-da') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5b50853-da, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: INFO os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:f1,bridge_name='br-int',has_traffic_filtering=True,id=a5b50853-da53-409a-9a0f-259f9f383098,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5b50853-da')
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=6cc8e19e-8229-4a2d-990d-b9c432ff3e38,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc8e19e-82') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=6cc8e19e-8229-4a2d-990d-b9c432ff3e38,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc8e19e-82') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cc8e19e-82, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: INFO os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=6cc8e19e-8229-4a2d-990d-b9c432ff3e38,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc8e19e-82')
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bb:b1,bridge_name='br-int',has_traffic_filtering=True,id=016c7245-66e3-42b3-9966-eedb6386be5d,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016c7245-66') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bb:b1,bridge_name='br-int',has_traffic_filtering=True,id=016c7245-66e3-42b3-9966-eedb6386be5d,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016c7245-66') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap016c7245-66, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: INFO os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:bb:b1,bridge_name='br-int',has_traffic_filtering=True,id=016c7245-66e3-42b3-9966-eedb6386be5d,network=Network(73936f72-f77c-4cfd-9f60-d524cd2c81d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016c7245-66')
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:25:90,bridge_name='br-int',has_traffic_filtering=True,id=a2e8b33f-8d89-4333-8921-722aba13278b,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e8b33f-8d') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:25:90,bridge_name='br-int',has_traffic_filtering=True,id=a2e8b33f-8d89-4333-8921-722aba13278b,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e8b33f-8d') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2e8b33f-8d, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: INFO os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:25:90,bridge_name='br-int',has_traffic_filtering=True,id=a2e8b33f-8d89-4333-8921-722aba13278b,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e8b33f-8d')
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1940058976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1940058976',id=9,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRq/0GDF0pSGgV8iJH4A9PNS9u7GNnmIWOU0vRvj+KgtuCBy9l7JMF2mMJkXTXo/ZAf3SfC+9wsBnDmqJIMPys9qnoAyUAvW1rg/SUD9rD6LnTQzGBG2Ktp4e/9MOENQ==',key_name='tempest-keypair-185703920',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0c848b490b47629051e961c682c5a5',ramdisk_id='',reservation_id='r-r3s9zba3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1317742003',owner_user_name='tempest-TaggedBootDevicesTest_v242-1317742003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e4b069991954c57993051fbe8665d35',uuid=ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converting VIF {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=18d9c10b-cff8-4cc5-9301-78d0d5a1dba7,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d9c10b-cf') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=18d9c10b-cff8-4cc5-9301-78d0d5a1dba7,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d9c10b-cf') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18d9c10b-cf, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: INFO os_vif [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=18d9c10b-cff8-4cc5-9301-78d0d5a1dba7,network=Network(1de55ad9-e848-440a-b980-eb0aa3fa74e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d9c10b-cf')
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvXoCNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:49 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[109faca4-1b34-455f-9616-86a0269d25d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:26:49 user nova-compute[82617]: No targets found.
Apr 17 15:26:49 user nova-compute[82617]: iSNS:
Apr 17 15:26:49 user nova-compute[82617]: No targets found.
Apr 17 15:26:49 user nova-compute[82617]: STATIC:
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: FIRMWARE:
Apr 17 15:26:49 user nova-compute[82617]: No targets found.
Apr 17 15:26:49 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:26:49 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:26:49 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[682973e4-fdd4-4f1d-b89d-35b204954b1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae9cb6-1bc3-482b-9190-cf9be38914dd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64870b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310'): ({'sdb'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Removing single pathed devices sdb {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[481553b2-5b21-48f2-b57f-95f3cc3f5317]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cfac1a-e1cc-46e9-902e-d99898deeb32]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Flushing IO for device /dev/sdb {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f8183a-4121-48f7-a3af-cf0aee0c0564]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f968c35-1d6c-43b4-ba18-2f99ebb699e5]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] SCSI volumes sdb have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[147526c9-1522-44a8-ba55-4d33292ddf33]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:49 user nova-compute[82617]: WARNING nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-735ea25c-24c9-40de-8245-af769da97133 for instance with vm_state active and task_state deleting.
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-unplugged-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-eed93fad-9763-444d-8483-d4eaeaad3e77 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:49 user nova-compute[82617]: WARNING nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-eed93fad-9763-444d-8483-d4eaeaad3e77 for instance with vm_state active and task_state deleting.
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-unplugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:49 user nova-compute[82617]: WARNING nova.compute.manager [req-bd23d0df-b748-452e-bec9-b86343784f58 req-d870b667-5416-4405-ae42-6539cba64039 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 for instance with vm_state active and task_state deleting.
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acf88fd-9fae-4478-885b-1f482c094f3e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310, portal: 172.16.0.220,3260]
Apr 17 15:26:49 user nova-compute[82617]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:49 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74b7878-4936-4015-8b63-142923947310 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1b9d42-c12b-4f9e-978d-d11a88258bfd]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== disconnect_volume: return (395ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmlSchIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:49 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ccdc2b-4137-46c2-b73e-4aa2e42e8d88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:26:49 user nova-compute[82617]: No targets found.
Apr 17 15:26:49 user nova-compute[82617]: iSNS:
Apr 17 15:26:49 user nova-compute[82617]: No targets found.
Apr 17 15:26:49 user nova-compute[82617]: STATIC:
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c
Apr 17 15:26:49 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:49 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:49 user nova-compute[82617]: FIRMWARE:
Apr 17 15:26:49 user nova-compute[82617]: No targets found.
Apr 17 15:26:49 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:26:49 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:26:49 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be884ce-e3b8-4ac4-ad4f-34e9bb1d6aa5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b77f6b-afbc-48c2-a9c2-478e7fe67779]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:49 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:49 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6482f9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f'): ({'sdc'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Removing single pathed devices sdc {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed23a63-59b4-4785-a688-97b9411206ae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccc326d-e6f8-4fba-8df7-56c57772ea8b]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Flushing IO for device /dev/sdc {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cecdac-27ae-479a-98c2-20a454c57a56]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c6bbfd-2657-40d0-9918-1a8b4f184822]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] SCSI volumes sdc have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:50 user nova-compute[82617]: WARNING nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-a5b50853-da53-409a-9a0f-259f9f383098 for instance with vm_state active and task_state deleting.
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-unplugged-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-016c7245-66e3-42b3-9966-eedb6386be5d for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:50 user nova-compute[82617]: WARNING nova.compute.manager [req-c345d896-8d51-4bd8-9eac-39bc8167b329 req-a0be381d-fb13-415a-9583-07d1936dd424 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-016c7245-66e3-42b3-9966-eedb6386be5d for instance with vm_state active and task_state deleting.
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b927cf9c-18f1-4f45-b0f4-8af6b91d1496]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[766904cd-02f7-4912-bb50-edce205d9c47]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f, portal: 172.16.0.220,3260]
Apr 17 15:26:50 user nova-compute[82617]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:50 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18475864-c202-4937-b18f-cc3e16c6d89f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5235c0fa-8fed-40ce-b7bb-7f6038ed257d]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== disconnect_volume: return (375ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wouATrvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:50 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b56ac2-e9f4-4414-8668-670b63e7a01c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:26:50 user nova-compute[82617]: No targets found.
Apr 17 15:26:50 user nova-compute[82617]: iSNS:
Apr 17 15:26:50 user nova-compute[82617]: No targets found.
Apr 17 15:26:50 user nova-compute[82617]: STATIC:
Apr 17 15:26:50 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095
Apr 17 15:26:50 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:50 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:50 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:26:50 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:50 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:50 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c
Apr 17 15:26:50 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:26:50 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:26:50 user nova-compute[82617]: FIRMWARE:
Apr 17 15:26:50 user nova-compute[82617]: No targets found.
Apr 17 15:26:50 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:26:50 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:26:50 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379fc95-6631-4d93-b0da-d487ff54320d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb682bae-e310-42cd-87b2-3af358621fda]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:50 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:50 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:50 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:50 user nova-compute[82617]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c (non-flash)
Apr 17 15:26:50 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:50 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64870bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c'): ({'sdd'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Removing single pathed devices sdd {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:50 user nova-compute[82617]: WARNING nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 for instance with vm_state active and task_state deleting.
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-unplugged-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-unplugged-a2e8b33f-8d89-4333-8921-722aba13278b for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Acquiring lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] No waiting events found dispatching network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:26:50 user nova-compute[82617]: WARNING nova.compute.manager [req-b74d1081-f926-400f-b1e8-cd4a700676ed req-06fbbb11-2ee4-4d7f-86f7-02c8c4bec585 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received unexpected event network-vif-plugged-a2e8b33f-8d89-4333-8921-722aba13278b for instance with vm_state active and task_state deleting.
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f735d6b6-b00b-4fcd-ba3d-30e5b008308a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8b0a6-a324-4083-8e50-2eab04f7ea03]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Flushing IO for device /dev/sdd {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[399891d6-a884-451c-8dd5-1b04f53473db]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b21133-5be1-4a8b-a698-eeb2c9ebcfc2]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] SCSI volumes sdd have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea428ba-d929-46aa-8b7c-5eef962eb194]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e47e36-4f58-4d6c-b0bb-b7b7cd36e82b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c, portal: 172.16.0.220,3260]
Apr 17 15:26:50 user nova-compute[82617]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:50 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a7c5eb-3af6-4afd-918f-ccb69a68641c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752278b-c0b7-4685-9351-e48b9a8021e3]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] <== disconnect_volume: return (352ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:26:50 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Deleting instance files /opt/stack/data/nova/instances/ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d_del
Apr 17 15:26:50 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Deletion of /opt/stack/data/nova/instances/ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d_del complete
Apr 17 15:26:50 user nova-compute[82617]: INFO nova.compute.manager [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Took 3.63 seconds to destroy the instance on the hypervisor.
Apr 17 15:26:50 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:26:50 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:26:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-da395cc1-322a-45d1-8268-9a7af0a2168d req-faec0e27-cfe2-4f4a-b7ee-cfa97594e9f3 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-deleted-735ea25c-24c9-40de-8245-af769da97133 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:52 user nova-compute[82617]: INFO nova.compute.manager [req-da395cc1-322a-45d1-8268-9a7af0a2168d req-faec0e27-cfe2-4f4a-b7ee-cfa97594e9f3 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Neutron deleted interface 735ea25c-24c9-40de-8245-af769da97133; detaching it from the instance and deleting it from the info cache
Apr 17 15:26:52 user nova-compute[82617]: DEBUG nova.network.neutron [req-da395cc1-322a-45d1-8268-9a7af0a2168d req-faec0e27-cfe2-4f4a-b7ee-cfa97594e9f3 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [{"id": "eed93fad-9763-444d-8483-d4eaeaad3e77", "address": "fa:16:3e:ad:2c:4e", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed93fad-97", "ovs_interfaceid": "eed93fad-9763-444d-8483-d4eaeaad3e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5b50853-da53-409a-9a0f-259f9f383098", "address": "fa:16:3e:0c:06:f1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b50853-da", "ovs_interfaceid": "a5b50853-da53-409a-9a0f-259f9f383098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "address": "fa:16:3e:82:90:c5", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc8e19e-82", "ovs_interfaceid": "6cc8e19e-8229-4a2d-990d-b9c432ff3e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "016c7245-66e3-42b3-9966-eedb6386be5d", "address": "fa:16:3e:1d:bb:b1", "network": {"id": "73936f72-f77c-4cfd-9f60-d524cd2c81d0", "bridge": "br-int", "label": "tempest-device-tagging-net1-763018704", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016c7245-66", "ovs_interfaceid": "016c7245-66e3-42b3-9966-eedb6386be5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e8b33f-8d89-4333-8921-722aba13278b", "address": "fa:16:3e:04:25:90", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e8b33f-8d", "ovs_interfaceid": "a2e8b33f-8d89-4333-8921-722aba13278b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "address": "fa:16:3e:c7:7f:09", "network": {"id": "1de55ad9-e848-440a-b980-eb0aa3fa74e6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2024704535", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8f0c848b490b47629051e961c682c5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d9c10b-cf", "ovs_interfaceid": "18d9c10b-cff8-4cc5-9301-78d0d5a1dba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-da395cc1-322a-45d1-8268-9a7af0a2168d req-faec0e27-cfe2-4f4a-b7ee-cfa97594e9f3 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Detach interface failed, port_id=735ea25c-24c9-40de-8245-af769da97133, reason: Instance ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '109c9a23-751e-4b29-abcf-0f003adb35cc', 'attached_at': '', 'detached_at': '', 'volume_id': '66000c93-eb12-4c23-8a69-71e1aa6b521f', 'serial': '66000c93-eb12-4c23-8a69-71e1aa6b521f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBubQvJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '485ea70c-618d-4373-a78f-a460914fc095'}, 'status': 'reserved', 'instance': '109c9a23-751e-4b29-abcf-0f003adb35cc', 'attached_at': '', 'detached_at': '', 'volume_id': '485ea70c-618d-4373-a78f-a460914fc095', 'serial'} {{(pid=82617) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:26:53 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:53 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:26:53 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5715a9d-b0b5-4cfb-bafd-f2b25375832c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:26:53 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acff6a6-9402-4cc6-a4da-644038ef44d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f] added
Apr 17 15:26:53 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5f382-f76c-4ef9-ae00-e91b9d3bb585]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ca955-1e5c-4a8a-898d-0c83a7bfa0b9]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygxXCJfw {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygxXCJfw" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7db55e-473f-41a4-b6eb-8a89ceb351b2]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygxXCJfw'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[895ea81a-6e09-4916-aa90-77785468b8f3]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e24f6c5-259e-4ff0-a095-7c647b79f92c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:53 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:53 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:53 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:53 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d12c3e-154d-45e1-9285-578a2c03ad70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260]
Apr 17 15:26:54 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260] successful.
Apr 17 15:26:54 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fac0d9-4791-4342-af66-1e954c7a7702]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[79743e69-0797-48a0-9af8-0296648f4539]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:54 user nova-compute[82617]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:54 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:54 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:26:54 user nova-compute[82617]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:26:54 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:26:54 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d67dcbf-4ca8-4554-9487-ad0b377a7be4]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:26:54 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Took 3.87 seconds to deallocate network for instance.
Apr 17 15:26:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-cbe0b24a-c9c2-4e37-baef-10c7e65aafec req-b43e7f3c-253e-457e-9e89-f7c5f553aaf9 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-deleted-6cc8e19e-8229-4a2d-990d-b9c432ff3e38 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-cbe0b24a-c9c2-4e37-baef-10c7e65aafec req-b43e7f3c-253e-457e-9e89-f7c5f553aaf9 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-deleted-a2e8b33f-8d89-4333-8921-722aba13278b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-cbe0b24a-c9c2-4e37-baef-10c7e65aafec req-b43e7f3c-253e-457e-9e89-f7c5f553aaf9 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-deleted-016c7245-66e3-42b3-9966-eedb6386be5d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-cbe0b24a-c9c2-4e37-baef-10c7e65aafec req-b43e7f3c-253e-457e-9e89-f7c5f553aaf9 service nova] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Received event network-vif-deleted-18d9c10b-cff8-4cc5-9301-78d0d5a1dba7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:26:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:26:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23338626565376231', 'path': '/dev/sdb'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:26:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338626565376231', 'path': '/dev/sdb'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:26:55 user nova-compute[82617]: DEBUG nova.objects.instance [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lazy-loading 'flavor' on Instance uuid 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:26:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:55 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745200.6277986, 3456d072-ae41-4bd2-bd5d-3622a9a5a23d => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:26:55 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] VM Stopped (Lifecycle Event)
Apr 17 15:26:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-999b0b2c-f9cb-417c-85c0-c196dd314c8d None None] [instance: 3456d072-ae41-4bd2-bd5d-3622a9a5a23d] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:26:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 267386880 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 400556032 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 477102080 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 605028352 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 748683264 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 897581056 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:26:59 user nova-compute[82617]: INFO nova.compute.manager [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Took 5.00 seconds to detach 3 volumes for instance.
Apr 17 15:26:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:26:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:26:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:26:59 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:26:59 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:26:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:26:59 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Deleted allocations for instance ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-e77294fa-8c23-4853-ad54-8d48216106ca tempest-TaggedBootDevicesTest_v242-1317742003 tempest-TaggedBootDevicesTest_v242-1317742003-project-member] Lock "ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.005s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBubQvJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '485ea70c-618d-4373-a78f-a460914fc095': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:00 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d8f533-1d80-498e-8f5b-fda616a01ebe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:27:00 user nova-compute[82617]: No targets found.
Apr 17 15:27:00 user nova-compute[82617]: iSNS:
Apr 17 15:27:00 user nova-compute[82617]: No targets found.
Apr 17 15:27:00 user nova-compute[82617]: STATIC:
Apr 17 15:27:00 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095
Apr 17 15:27:00 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:27:00 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:27:00 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f
Apr 17 15:27:00 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:27:00 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:27:00 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:27:00 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:27:00 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:27:00 user nova-compute[82617]: FIRMWARE:
Apr 17 15:27:00 user nova-compute[82617]: No targets found.
Apr 17 15:27:00 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:27:00 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:27:00 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[190755a9-19f6-4b76-a90b-0beddb3772b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b05c25c-bd3d-4bf6-b286-8631da0e5599]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:27:00 user nova-compute[82617]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:27:00 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:27:00 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 (non-flash)
Apr 17 15:27:00 user nova-compute[82617]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:27:00 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:27:00 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6482f9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095'): ({'sdf'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Removing single pathed devices sdf {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[96586353-a2c4-418b-b586-fd711884e1fe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[145df008-08b7-453e-8734-302d05876c8a]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Flushing IO for device /dev/sdf {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b427eaf-c014-436e-96ed-f565f356dcad]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6d97d7-19d8-4744-a12b-adf007c209f5]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] SCSI volumes sdf have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[47617742-bc55-4ba1-a0be-be67693d8408]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5745451e-41d7-4f7c-b1fc-41719fb56755]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095, portal: 172.16.0.220,3260]
Apr 17 15:27:00 user nova-compute[82617]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095, portal: 172.16.0.220,3260] successful.
Apr 17 15:27:00 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485ea70c-618d-4373-a78f-a460914fc095 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8472a250-16b4-4b17-8203-609974ac2491]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] <== disconnect_volume: return (309ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '109c9a23-751e-4b29-abcf-0f003adb35cc', 'attached_at': '', 'detached_at': '', 'volume_id': '66000c93-eb12-4c23-8a69-71e1aa6b521f', 'serial'} {{(pid=82617) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 17 15:27:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] swap_volume: removing Cinder connection for volume 485ea70c-618d-4373-a78f-a460914fc095 {{(pid=82617) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 17 15:27:02 user nova-compute[82617]: DEBUG nova.compute.manager [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] swap_volume: Updating volume 485ea70c-618d-4373-a78f-a460914fc095 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ygxXCJfw", "auth_password": "kRj6WPpS5zq2r1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "66000c93-eb12-4c23-8a69-71e1aa6b521f"}, "status": "reserved", "instance": "109c9a23-751e-4b29-abcf-0f003adb35cc", "attached_at": "", "detached_at": "", "volume_id": "66000c93-eb12-4c23-8a69-71e1aa6b521f", "serial": "66000c93-eb12-4c23-8a69-71e1aa6b521f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '66000c93-eb12-4c23-8a69-71e1aa6b521f', 'no_device': None, 'attachment_id': '69941f8a-0395-4c45-90b6-e2f0055de4d1'} {{(pid=82617) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 17 15:27:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-017c30e5-4553-487c-b935-9661e8bec910 tempest-TestVolumeSwap-1210043716 tempest-TestVolumeSwap-1210043716-project-admin] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.948s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:03 user nova-compute[82617]: INFO nova.compute.manager [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Detaching volume 66000c93-eb12-4c23-8a69-71e1aa6b521f
Apr 17 15:27:03 user nova-compute[82617]: INFO nova.virt.block_device [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Attempting to driver detach volume 66000c93-eb12-4c23-8a69-71e1aa6b521f from mountpoint /dev/vdb
Apr 17 15:27:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Attempting to detach device vdb from instance 109c9a23-751e-4b29-abcf-0f003adb35cc from the persistent domain config. {{(pid=82617) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 15:27:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:27:03 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:27:03 user nova-compute[82617]:   <source dev="/dev/sdb"/>
Apr 17 15:27:03 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:27:03 user nova-compute[82617]:   <serial>66000c93-eb12-4c23-8a69-71e1aa6b521f</serial>
Apr 17 15:27:03 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 15:27:03 user nova-compute[82617]: </disk>
Apr 17 15:27:03 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:27:03 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Successfully detached device vdb from instance 109c9a23-751e-4b29-abcf-0f003adb35cc from the persistent domain config.
Apr 17 15:27:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 109c9a23-751e-4b29-abcf-0f003adb35cc from the live domain config. {{(pid=82617) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 15:27:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:27:03 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:27:03 user nova-compute[82617]:   <source dev="/dev/sdb"/>
Apr 17 15:27:03 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:27:03 user nova-compute[82617]:   <serial>66000c93-eb12-4c23-8a69-71e1aa6b521f</serial>
Apr 17 15:27:03 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 15:27:03 user nova-compute[82617]: </disk>
Apr 17 15:27:03 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:27:03 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745208.9596975, ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:27:03 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] VM Stopped (Lifecycle Event)
Apr 17 15:27:03 user nova-compute[82617]: DEBUG nova.compute.manager [None req-064f2299-aaa8-43e2-bd0d-495d08323a71 None None] [instance: ef6c2cfb-c1ca-4bda-ac71-c628c2c6ff4d] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Received event <DeviceRemovedEvent: 1681745224.21225, 109c9a23-751e-4b29-abcf-0f003adb35cc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82617) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 15:27:04 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Successfully detached device vdb from instance 109c9a23-751e-4b29-abcf-0f003adb35cc from the live domain config.
Apr 17 15:27:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxXCJfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '66000c93-eb12-4c23-8a69-71e1aa6b521f': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:04 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5303d54c-f8df-45c6-8ca7-553a158b4e49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:27:04 user nova-compute[82617]: No targets found.
Apr 17 15:27:04 user nova-compute[82617]: iSNS:
Apr 17 15:27:04 user nova-compute[82617]: No targets found.
Apr 17 15:27:04 user nova-compute[82617]: STATIC:
Apr 17 15:27:04 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f
Apr 17 15:27:04 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:27:04 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:27:04 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:27:04 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:27:04 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:27:04 user nova-compute[82617]: FIRMWARE:
Apr 17 15:27:04 user nova-compute[82617]: No targets found.
Apr 17 15:27:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:27:04 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:27:04 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ebf127-f94b-4809-ac78-fb4073b789f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2ede1b-1d7c-4940-8378-11cd5d343d1d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:27:04 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:27:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f (non-flash)
Apr 17 15:27:04 user nova-compute[82617]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:27:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648708a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f'): ({'sdb'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Removing single pathed devices sdb {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a4aec1-ed20-42d8-83db-b064f45741cc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9c9c11-55eb-4ef4-abad-37f0642ba6cc]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Flushing IO for device /dev/sdb {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c89ab58-875a-4b84-89a0-fa5c64f000a2]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c4cc1-a057-4847-91e9-d1e8d65621bf]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] SCSI volumes sdb have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3dd39d-28ef-4c44-9aae-1497e7884b1d]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[165882a4-1731-4897-b508-a5669253e5ae]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260]
Apr 17 15:27:04 user nova-compute[82617]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f, portal: 172.16.0.220,3260] successful.
Apr 17 15:27:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66000c93-eb12-4c23-8a69-71e1aa6b521f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[805680ac-669f-46b3-af73-d28be99d6727]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] <== disconnect_volume: return (298ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:27:05 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lazy-loading 'flavor' on Instance uuid 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6dca4c82-5919-4549-9ef9-2dd9c5ab78c8 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.894s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "c0e53ff8-38c3-4353-a225-22ceae908f50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:27:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:19 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:27:19 user nova-compute[82617]: INFO nova.compute.claims [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Claim successful on node user
Apr 17 15:27:20 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG nova.network.neutron [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:27:20 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:27:20 user nova-compute[82617]: DEBUG nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:27:20 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Creating image(s)
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "/opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "/opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk 1073741824" returned: 0 in 0.048s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:20 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.policy [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dfadfd30c394b46abe75ec930007850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b334c5bc33f143c484518d9bd0e750dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Cannot resize image /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.objects.instance [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'migration_context' on Instance uuid c0e53ff8-38c3-4353-a225-22ceae908f50 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Ensure instance console log exists: /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "ddc8a602-70e9-4697-b75b-c602ad4c2447" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:21 user nova-compute[82617]: INFO nova.compute.manager [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Terminating instance
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.compute.manager [req-063f46c9-7049-4701-a657-94d07bf75f32 req-b1b0a8e3-d296-4ef9-aaeb-043e9c7471a9 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received event network-vif-unplugged-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-063f46c9-7049-4701-a657-94d07bf75f32 req-b1b0a8e3-d296-4ef9-aaeb-043e9c7471a9 service nova] Acquiring lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-063f46c9-7049-4701-a657-94d07bf75f32 req-b1b0a8e3-d296-4ef9-aaeb-043e9c7471a9 service nova] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-063f46c9-7049-4701-a657-94d07bf75f32 req-b1b0a8e3-d296-4ef9-aaeb-043e9c7471a9 service nova] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.compute.manager [req-063f46c9-7049-4701-a657-94d07bf75f32 req-b1b0a8e3-d296-4ef9-aaeb-043e9c7471a9 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] No waiting events found dispatching network-vif-unplugged-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:21 user nova-compute[82617]: DEBUG nova.compute.manager [req-063f46c9-7049-4701-a657-94d07bf75f32 req-b1b0a8e3-d296-4ef9-aaeb-043e9c7471a9 service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received event network-vif-unplugged-80be52be-1998-4d71-b2d6-598239b3c2a7 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG nova.network.neutron [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Successfully created port: 1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:27:22 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Instance destroyed successfully.
Apr 17 15:27:22 user nova-compute[82617]: DEBUG nova.objects.instance [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lazy-loading 'resources' on Instance uuid ddc8a602-70e9-4697-b75b-c602ad4c2447 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-513092781',display_name='tempest-VolumesActionsTest-instance-513092781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-513092781',id=10,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8b97ff6ed6047f0a33e74684a1c162b',ramdisk_id='',reservation_id='r-3gw1j5r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-707453245',owner_user_name='tempest-VolumesActionsTest-707453245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:30Z,user_data=None,user_id='c993ceeb4a5c49eea14057e2125518ad',uuid=ddc8a602-70e9-4697-b75b-c602ad4c2447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Converting VIF {"id": "80be52be-1998-4d71-b2d6-598239b3c2a7", "address": "fa:16:3e:a8:37:3e", "network": {"id": "28b8c668-d290-4e32-b2e2-7df0a657f4d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-482834141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a8b97ff6ed6047f0a33e74684a1c162b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80be52be-19", "ovs_interfaceid": "80be52be-1998-4d71-b2d6-598239b3c2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=80be52be-1998-4d71-b2d6-598239b3c2a7,network=Network(28b8c668-d290-4e32-b2e2-7df0a657f4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80be52be-19') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG os_vif [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=80be52be-1998-4d71-b2d6-598239b3c2a7,network=Network(28b8c668-d290-4e32-b2e2-7df0a657f4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80be52be-19') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80be52be-19, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:22 user nova-compute[82617]: INFO os_vif [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=80be52be-1998-4d71-b2d6-598239b3c2a7,network=Network(28b8c668-d290-4e32-b2e2-7df0a657f4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80be52be-19')
Apr 17 15:27:22 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Deleting instance files /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447_del
Apr 17 15:27:22 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Deletion of /opt/stack/data/nova/instances/ddc8a602-70e9-4697-b75b-c602ad4c2447_del complete
Apr 17 15:27:22 user nova-compute[82617]: INFO nova.compute.manager [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 17 15:27:22 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:27:22 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:23 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Took 0.68 seconds to deallocate network for instance.
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-ea3e6abc-50a9-4ef2-aa7a-84a2013b98ca req-8f3c6fae-a8d7-4bbb-81f5-efbefb121392 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received event network-changed-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-ea3e6abc-50a9-4ef2-aa7a-84a2013b98ca req-8f3c6fae-a8d7-4bbb-81f5-efbefb121392 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Refreshing instance network info cache due to event network-changed-8dbf801a-36a8-4443-9367-e795d4689bbc. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ea3e6abc-50a9-4ef2-aa7a-84a2013b98ca req-8f3c6fae-a8d7-4bbb-81f5-efbefb121392 service nova] Acquiring lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ea3e6abc-50a9-4ef2-aa7a-84a2013b98ca req-8f3c6fae-a8d7-4bbb-81f5-efbefb121392 service nova] Acquired lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.network.neutron [req-ea3e6abc-50a9-4ef2-aa7a-84a2013b98ca req-8f3c6fae-a8d7-4bbb-81f5-efbefb121392 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Refreshing network info cache for port 8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:27:23 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Deleted allocations for instance ddc8a602-70e9-4697-b75b-c602ad4c2447
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c6f30318-add9-4b60-ba92-15dc33e8c5b3 tempest-VolumesActionsTest-707453245 tempest-VolumesActionsTest-707453245-project-member] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.network.neutron [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Successfully updated port: 1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquired lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.network.neutron [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:23 user nova-compute[82617]: INFO nova.compute.manager [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Shelve offloading
Apr 17 15:27:23 user nova-compute[82617]: DEBUG nova.network.neutron [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-2b9c6acc-c7f2-430a-a9d3-0ce819ce8141 req-98aa1539-d112-4a93-b193-cdaa7a82350c service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received event network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2b9c6acc-c7f2-430a-a9d3-0ce819ce8141 req-98aa1539-d112-4a93-b193-cdaa7a82350c service nova] Acquiring lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2b9c6acc-c7f2-430a-a9d3-0ce819ce8141 req-98aa1539-d112-4a93-b193-cdaa7a82350c service nova] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2b9c6acc-c7f2-430a-a9d3-0ce819ce8141 req-98aa1539-d112-4a93-b193-cdaa7a82350c service nova] Lock "ddc8a602-70e9-4697-b75b-c602ad4c2447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-2b9c6acc-c7f2-430a-a9d3-0ce819ce8141 req-98aa1539-d112-4a93-b193-cdaa7a82350c service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] No waiting events found dispatching network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:24 user nova-compute[82617]: WARNING nova.compute.manager [req-2b9c6acc-c7f2-430a-a9d3-0ce819ce8141 req-98aa1539-d112-4a93-b193-cdaa7a82350c service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received unexpected event network-vif-plugged-80be52be-1998-4d71-b2d6-598239b3c2a7 for instance with vm_state deleted and task_state None.
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-2b9c6acc-c7f2-430a-a9d3-0ce819ce8141 req-98aa1539-d112-4a93-b193-cdaa7a82350c service nova] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Received event network-vif-deleted-80be52be-1998-4d71-b2d6-598239b3c2a7 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.network.neutron [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Updating instance_info_cache with network_info: [{"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Releasing lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Instance network_info: |[{"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Start _get_guest_xml network_info=[{"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:27:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:27:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-845854553',display_name='tempest-VolumesAdminNegativeTest-server-845854553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-845854553',id=12,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b334c5bc33f143c484518d9bd0e750dd',ramdisk_id='',reservation_id='r-n3dowwrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1285212149',owner_user_name='tempest-VolumesAdminNegativeTest-1285212149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:20Z,user_data=None,user_id='3dfadfd30c394b46abe75ec930007850',uuid=c0e53ff8-38c3-4353-a225-22ceae908f50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converting VIF {"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2d:f4,bridge_name='br-int',has_traffic_filtering=True,id=1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee7dd3a-30') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.objects.instance [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'pci_devices' on Instance uuid c0e53ff8-38c3-4353-a225-22ceae908f50 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:27:24 user nova-compute[82617]:   <uuid>c0e53ff8-38c3-4353-a225-22ceae908f50</uuid>
Apr 17 15:27:24 user nova-compute[82617]:   <name>instance-0000000c</name>
Apr 17 15:27:24 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:27:24 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:27:24 user nova-compute[82617]:   <metadata>
Apr 17 15:27:24 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:27:24 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:27:24 user nova-compute[82617]:       <nova:name>tempest-VolumesAdminNegativeTest-server-845854553</nova:name>
Apr 17 15:27:24 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:27:24</nova:creationTime>
Apr 17 15:27:24 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:27:24 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:27:24 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:27:24 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:27:24 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:27:24 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:27:24 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:27:24 user nova-compute[82617]:       <nova:owner>
Apr 17 15:27:24 user nova-compute[82617]:         <nova:user uuid="3dfadfd30c394b46abe75ec930007850">tempest-VolumesAdminNegativeTest-1285212149-project-member</nova:user>
Apr 17 15:27:24 user nova-compute[82617]:         <nova:project uuid="b334c5bc33f143c484518d9bd0e750dd">tempest-VolumesAdminNegativeTest-1285212149</nova:project>
Apr 17 15:27:24 user nova-compute[82617]:       </nova:owner>
Apr 17 15:27:24 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:27:24 user nova-compute[82617]:       <nova:ports>
Apr 17 15:27:24 user nova-compute[82617]:         <nova:port uuid="1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6">
Apr 17 15:27:24 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 17 15:27:24 user nova-compute[82617]:         </nova:port>
Apr 17 15:27:24 user nova-compute[82617]:       </nova:ports>
Apr 17 15:27:24 user nova-compute[82617]:     </nova:instance>
Apr 17 15:27:24 user nova-compute[82617]:   </metadata>
Apr 17 15:27:24 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:27:24 user nova-compute[82617]:     <system>
Apr 17 15:27:24 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:27:24 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:27:24 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:27:24 user nova-compute[82617]:       <entry name="serial">c0e53ff8-38c3-4353-a225-22ceae908f50</entry>
Apr 17 15:27:24 user nova-compute[82617]:       <entry name="uuid">c0e53ff8-38c3-4353-a225-22ceae908f50</entry>
Apr 17 15:27:24 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:27:24 user nova-compute[82617]:     </system>
Apr 17 15:27:24 user nova-compute[82617]:   </sysinfo>
Apr 17 15:27:24 user nova-compute[82617]:   <os>
Apr 17 15:27:24 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:27:24 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:27:24 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:27:24 user nova-compute[82617]:   </os>
Apr 17 15:27:24 user nova-compute[82617]:   <features>
Apr 17 15:27:24 user nova-compute[82617]:     <acpi/>
Apr 17 15:27:24 user nova-compute[82617]:     <apic/>
Apr 17 15:27:24 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:27:24 user nova-compute[82617]:   </features>
Apr 17 15:27:24 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:27:24 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:27:24 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:27:24 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:27:24 user nova-compute[82617]:   </clock>
Apr 17 15:27:24 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:27:24 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:27:24 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:27:24 user nova-compute[82617]:   </cpu>
Apr 17 15:27:24 user nova-compute[82617]:   <devices>
Apr 17 15:27:24 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:27:24 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:27:24 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk"/>
Apr 17 15:27:24 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:27:24 user nova-compute[82617]:     </disk>
Apr 17 15:27:24 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:27:24 user nova-compute[82617]:       <mac address="fa:16:3e:e7:2d:f4"/>
Apr 17 15:27:24 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:27:24 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:27:24 user nova-compute[82617]:       <target dev="tap1ee7dd3a-30"/>
Apr 17 15:27:24 user nova-compute[82617]:     </interface>
Apr 17 15:27:24 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:27:24 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/console.log" append="off"/>
Apr 17 15:27:24 user nova-compute[82617]:     </serial>
Apr 17 15:27:24 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:27:24 user nova-compute[82617]:     <video>
Apr 17 15:27:24 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:27:24 user nova-compute[82617]:     </video>
Apr 17 15:27:24 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:27:24 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:27:24 user nova-compute[82617]:     </rng>
Apr 17 15:27:24 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:27:24 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:27:24 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:27:24 user nova-compute[82617]:     </memballoon>
Apr 17 15:27:24 user nova-compute[82617]:   </devices>
Apr 17 15:27:24 user nova-compute[82617]: </domain>
Apr 17 15:27:24 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-845854553',display_name='tempest-VolumesAdminNegativeTest-server-845854553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-845854553',id=12,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b334c5bc33f143c484518d9bd0e750dd',ramdisk_id='',reservation_id='r-n3dowwrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1285212149',owner_user_name='tempest-VolumesAdminNegativeTest-1285212149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:20Z,user_data=None,user_id='3dfadfd30c394b46abe75ec930007850',uuid=c0e53ff8-38c3-4353-a225-22ceae908f50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converting VIF {"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2d:f4,bridge_name='br-int',has_traffic_filtering=True,id=1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee7dd3a-30') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG os_vif [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2d:f4,bridge_name='br-int',has_traffic_filtering=True,id=1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee7dd3a-30') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ee7dd3a-30, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ee7dd3a-30, col_values=(('external_ids', {'iface-id': '1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:2d:f4', 'vm-uuid': 'c0e53ff8-38c3-4353-a225-22ceae908f50'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:24 user nova-compute[82617]: INFO os_vif [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2d:f4,bridge_name='br-int',has_traffic_filtering=True,id=1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee7dd3a-30')
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] No VIF found with MAC fa:16:3e:e7:2d:f4, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.network.neutron [req-ea3e6abc-50a9-4ef2-aa7a-84a2013b98ca req-8f3c6fae-a8d7-4bbb-81f5-efbefb121392 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updated VIF entry in instance network info cache for port 8dbf801a-36a8-4443-9367-e795d4689bbc. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG nova.network.neutron [req-ea3e6abc-50a9-4ef2-aa7a-84a2013b98ca req-8f3c6fae-a8d7-4bbb-81f5-efbefb121392 service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updating instance_info_cache with network_info: [{"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ea3e6abc-50a9-4ef2-aa7a-84a2013b98ca req-8f3c6fae-a8d7-4bbb-81f5-efbefb121392 service nova] Releasing lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:25 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Instance destroyed successfully.
Apr 17 15:27:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquired lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG nova.network.neutron [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-cd265de9-5dc8-4440-aafb-58386def93f4 req-da557c08-45fd-4584-b88c-117f771c7dcf service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received event network-changed-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-cd265de9-5dc8-4440-aafb-58386def93f4 req-da557c08-45fd-4584-b88c-117f771c7dcf service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Refreshing instance network info cache due to event network-changed-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cd265de9-5dc8-4440-aafb-58386def93f4 req-da557c08-45fd-4584-b88c-117f771c7dcf service nova] Acquiring lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cd265de9-5dc8-4440-aafb-58386def93f4 req-da557c08-45fd-4584-b88c-117f771c7dcf service nova] Acquired lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG nova.network.neutron [req-cd265de9-5dc8-4440-aafb-58386def93f4 req-da557c08-45fd-4584-b88c-117f771c7dcf service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Refreshing network info cache for port 1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG nova.network.neutron [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updating instance_info_cache with network_info: [{"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Releasing lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received event network-vif-unplugged-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] Acquiring lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] No waiting events found dispatching network-vif-unplugged-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:26 user nova-compute[82617]: WARNING nova.compute.manager [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received unexpected event network-vif-unplugged-8dbf801a-36a8-4443-9367-e795d4689bbc for instance with vm_state active and task_state shelving.
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received event network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] Acquiring lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] No waiting events found dispatching network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:26 user nova-compute[82617]: WARNING nova.compute.manager [req-a15b46b9-d177-4c0b-a9e4-79fba25879d4 req-e0b13ec2-b6e8-400e-b419-4d953cb0bd8d service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received unexpected event network-vif-plugged-8dbf801a-36a8-4443-9367-e795d4689bbc for instance with vm_state active and task_state shelving.
Apr 17 15:27:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.network.neutron [req-cd265de9-5dc8-4440-aafb-58386def93f4 req-da557c08-45fd-4584-b88c-117f771c7dcf service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Updated VIF entry in instance network info cache for port 1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.network.neutron [req-cd265de9-5dc8-4440-aafb-58386def93f4 req-da557c08-45fd-4584-b88c-117f771c7dcf service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Updating instance_info_cache with network_info: [{"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cd265de9-5dc8-4440-aafb-58386def93f4 req-da557c08-45fd-4584-b88c-117f771c7dcf service nova] Releasing lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:26 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Instance destroyed successfully.
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.objects.instance [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lazy-loading 'resources' on Instance uuid edb2d74c-f1e0-4954-9ba9-812fc12562a7 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:25:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2065924545',display_name='tempest-TestShelveInstance-server-2065924545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2065924545',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVsDBXTpDwPUDZ3qwrjtkm/FJOXPmfagxCn+shNEPRPuwp+1B/JL0NwZS4lJfZsYclOhazIWS4EKbhzG0tIbl8IxrZY7Rql2V8DiRFQqkdSjnVif0EwcrAoIjo8dMGt1A==',key_name='tempest-TestShelveInstance-1958416844',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:25:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2df343eb0d64207a5f9f91aa0810999',ramdisk_id='',reservation_id='r-ddwuh0uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1683612675',owner_user_name='tempest-TestShelveInstance-1683612675-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:25:42Z,user_data=None,user_id='909c09f2587f42f895352916d3f8636a',uuid=edb2d74c-f1e0-4954-9ba9-812fc12562a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Converting VIF {"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dbf801a-36", "ovs_interfaceid": "8dbf801a-36a8-4443-9367-e795d4689bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e1:47,bridge_name='br-int',has_traffic_filtering=True,id=8dbf801a-36a8-4443-9367-e795d4689bbc,network=Network(91c16f73-094f-4b02-83d2-468d885641ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dbf801a-36') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_vif [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e1:47,bridge_name='br-int',has_traffic_filtering=True,id=8dbf801a-36a8-4443-9367-e795d4689bbc,network=Network(91c16f73-094f-4b02-83d2-468d885641ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dbf801a-36') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8dbf801a-36, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:26 user nova-compute[82617]: INFO os_vif [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e1:47,bridge_name='br-int',has_traffic_filtering=True,id=8dbf801a-36a8-4443-9367-e795d4689bbc,network=Network(91c16f73-094f-4b02-83d2-468d885641ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dbf801a-36')
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVRqMWdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:26 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc2a2be-3f27-4530-a1bd-de21fed28221]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:27:26 user nova-compute[82617]: No targets found.
Apr 17 15:27:26 user nova-compute[82617]: iSNS:
Apr 17 15:27:26 user nova-compute[82617]: No targets found.
Apr 17 15:27:26 user nova-compute[82617]: STATIC:
Apr 17 15:27:26 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6
Apr 17 15:27:26 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:27:26 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:27:26 user nova-compute[82617]: FIRMWARE:
Apr 17 15:27:26 user nova-compute[82617]: No targets found.
Apr 17 15:27:26 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:27:26 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:27:26 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[38340452-eab4-431c-8a11-4bd9bb1b8437]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9115b77b-60b6-4c98-8edc-5c305c4768db]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:27:26 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 (non-flash)
Apr 17 15:27:26 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6483d44c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6'): ({'sde'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Removing single pathed devices sde {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b56f9b6-0c8e-455c-95ae-c7ce5b66ea72]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e27895-9724-4d4b-8d94-49d5f930a716]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Flushing IO for device /dev/sde {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72a314f-4f23-45ea-ad61-abb4011c0194]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f30e0c-4b11-4024-b0bc-69a84511bf14]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] SCSI volumes sde have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[824d0b35-9d5b-4b46-ba5b-5cbdbce5b089]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ba175a-9dc2-4fbb-b38b-86e6a90c4545]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6, portal: 172.16.0.220,3260]
Apr 17 15:27:26 user nova-compute[82617]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6, portal: 172.16.0.220,3260] successful.
Apr 17 15:27:26 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d895d11d-6880-4418-a9ad-feca813ed5d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a83910-a7de-40be-ad4d-760de4572e9b]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] <== disconnect_volume: return (282ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:27:26 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Deleting instance files /opt/stack/data/nova/instances/edb2d74c-f1e0-4954-9ba9-812fc12562a7_del
Apr 17 15:27:26 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Deletion of /opt/stack/data/nova/instances/edb2d74c-f1e0-4954-9ba9-812fc12562a7_del complete
Apr 17 15:27:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received event network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] Acquiring lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] No waiting events found dispatching network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:27 user nova-compute[82617]: WARNING nova.compute.manager [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received unexpected event network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 for instance with vm_state building and task_state spawning.
Apr 17 15:27:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received event network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] Acquiring lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG nova.compute.manager [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] No waiting events found dispatching network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:27 user nova-compute[82617]: WARNING nova.compute.manager [req-ad5b9863-b697-428a-b090-b07956e4ecb3 req-ec4ce54a-3299-4c19-a5eb-6a876443c3f7 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received unexpected event network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 for instance with vm_state building and task_state spawning.
Apr 17 15:27:27 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Deleted allocations for instance edb2d74c-f1e0-4954-9ba9-812fc12562a7
Apr 17 15:27:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:27 user nova-compute[82617]: DEBUG nova.objects.instance [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lazy-loading 'numa_topology' on Instance uuid edb2d74c-f1e0-4954-9ba9-812fc12562a7 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-30cb031e-a823-47d1-a295-13895e0d7dcb req-caae2fda-4518-4053-b501-0f87f9a1e10e service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Received event network-changed-8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-30cb031e-a823-47d1-a295-13895e0d7dcb req-caae2fda-4518-4053-b501-0f87f9a1e10e service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Refreshing instance network info cache due to event network-changed-8dbf801a-36a8-4443-9367-e795d4689bbc. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-30cb031e-a823-47d1-a295-13895e0d7dcb req-caae2fda-4518-4053-b501-0f87f9a1e10e service nova] Acquiring lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-30cb031e-a823-47d1-a295-13895e0d7dcb req-caae2fda-4518-4053-b501-0f87f9a1e10e service nova] Acquired lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.network.neutron [req-30cb031e-a823-47d1-a295-13895e0d7dcb req-caae2fda-4518-4053-b501-0f87f9a1e10e service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Refreshing network info cache for port 8dbf801a-36a8-4443-9367-e795d4689bbc {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745248.463978, c0e53ff8-38c3-4353-a225-22ceae908f50 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:27:28 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] VM Resumed (Lifecycle Event)
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:28 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Instance spawned successfully.
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.580s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:28 user nova-compute[82617]: INFO nova.compute.manager [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Terminating instance
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:27:28 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745248.465548, c0e53ff8-38c3-4353-a225-22ceae908f50 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:27:28 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] VM Started (Lifecycle Event)
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-1f4b549a-26d0-4230-a266-eaf4b89d5f6c tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.730s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:28 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:27:28 user nova-compute[82617]: INFO nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Took 8.03 seconds to spawn the instance on the hypervisor.
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:28 user nova-compute[82617]: INFO nova.compute.manager [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Took 8.86 seconds to build instance.
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-792d2a98-26a8-4671-ad37-cd1301776d0a tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.990s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-1971eb11-6894-4a06-9840-6977eda92bf9 req-88703803-1f60-4b25-896b-d64a661794aa service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-unplugged-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1971eb11-6894-4a06-9840-6977eda92bf9 req-88703803-1f60-4b25-896b-d64a661794aa service nova] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1971eb11-6894-4a06-9840-6977eda92bf9 req-88703803-1f60-4b25-896b-d64a661794aa service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1971eb11-6894-4a06-9840-6977eda92bf9 req-88703803-1f60-4b25-896b-d64a661794aa service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-1971eb11-6894-4a06-9840-6977eda92bf9 req-88703803-1f60-4b25-896b-d64a661794aa service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] No waiting events found dispatching network-vif-unplugged-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-1971eb11-6894-4a06-9840-6977eda92bf9 req-88703803-1f60-4b25-896b-d64a661794aa service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-unplugged-d1c7ec7e-3825-4422-ae8b-82505961b10d for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.network.neutron [req-30cb031e-a823-47d1-a295-13895e0d7dcb req-caae2fda-4518-4053-b501-0f87f9a1e10e service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updated VIF entry in instance network info cache for port 8dbf801a-36a8-4443-9367-e795d4689bbc. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.network.neutron [req-30cb031e-a823-47d1-a295-13895e0d7dcb req-caae2fda-4518-4053-b501-0f87f9a1e10e service nova] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updating instance_info_cache with network_info: [{"id": "8dbf801a-36a8-4443-9367-e795d4689bbc", "address": "fa:16:3e:d9:e1:47", "network": {"id": "91c16f73-094f-4b02-83d2-468d885641ee", "bridge": null, "label": "tempest-TestShelveInstance-1213443516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2df343eb0d64207a5f9f91aa0810999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8dbf801a-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-30cb031e-a823-47d1-a295-13895e0d7dcb req-caae2fda-4518-4053-b501-0f87f9a1e10e service nova] Releasing lock "refresh_cache-edb2d74c-f1e0-4954-9ba9-812fc12562a7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:29 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Instance destroyed successfully.
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.objects.instance [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lazy-loading 'resources' on Instance uuid c1fafed5-dcf8-4bac-8b38-f2067e47bd1c {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-17T15:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1823140976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1823140976',id=8,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUfHnESoVXPXi9ptdNvQZ84Ee9hbXkk0ExtIQFN0+4bRf8Gw1SKqE0OkJ3a+urW6oJfBopuykh0VzTN212r/3wGIPauF1zsICIzN843Fa+vOY9Vmjx0m4DGpvIcKrqkuQ==',key_name='tempest-keypair-201206862',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dfa73323c3c4c689f4012505d8b4833',ramdisk_id='',reservation_id='r-f1zz6xdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1309189231',owner_user_name='tempest-TaggedAttachmentsTest-1309189231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f081ecb75ec14053b68d74cacf61c802',uuid=c1fafed5-dcf8-4bac-8b38-f2067e47bd1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converting VIF {"id": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "address": "fa:16:3e:cb:da:dc", "network": {"id": "a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1022752468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dfa73323c3c4c689f4012505d8b4833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c7ec7e-38", "ovs_interfaceid": "d1c7ec7e-3825-4422-ae8b-82505961b10d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1c7ec7e-3825-4422-ae8b-82505961b10d,network=Network(a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c7ec7e-38') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG os_vif [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1c7ec7e-3825-4422-ae8b-82505961b10d,network=Network(a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c7ec7e-38') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1c7ec7e-38, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:29 user nova-compute[82617]: INFO os_vif [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:da:dc,bridge_name='br-int',has_traffic_filtering=True,id=d1c7ec7e-3825-4422-ae8b-82505961b10d,network=Network(a25a7d8c-ebe0-4226-8bc7-bbcfab1ecb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c7ec7e-38')
Apr 17 15:27:29 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Deleting instance files /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c_del
Apr 17 15:27:29 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Deletion of /opt/stack/data/nova/instances/c1fafed5-dcf8-4bac-8b38-f2067e47bd1c_del complete
Apr 17 15:27:29 user nova-compute[82617]: INFO nova.compute.manager [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:29 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Error from libvirt while getting description of instance-00000008: [Error Code 42] Domain not found: no domain with matching uuid 'c1fafed5-dcf8-4bac-8b38-f2067e47bd1c' (instance-00000008): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c1fafed5-dcf8-4bac-8b38-f2067e47bd1c' (instance-00000008)
Apr 17 15:27:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-5238f246-15cb-4a9c-9031-80a60d3cda7f req-d8ab2446-b167-4938-a4ed-f5f7e7b78327 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-deleted-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:30 user nova-compute[82617]: INFO nova.compute.manager [req-5238f246-15cb-4a9c-9031-80a60d3cda7f req-d8ab2446-b167-4938-a4ed-f5f7e7b78327 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Neutron deleted interface d1c7ec7e-3825-4422-ae8b-82505961b10d; detaching it from the instance and deleting it from the info cache
Apr 17 15:27:30 user nova-compute[82617]: DEBUG nova.network.neutron [req-5238f246-15cb-4a9c-9031-80a60d3cda7f req-d8ab2446-b167-4938-a4ed-f5f7e7b78327 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-5238f246-15cb-4a9c-9031-80a60d3cda7f req-d8ab2446-b167-4938-a4ed-f5f7e7b78327 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Detach interface failed, port_id=d1c7ec7e-3825-4422-ae8b-82505961b10d, reason: Instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:27:30 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Took 1.20 seconds to deallocate network for instance.
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.manager [req-0442e696-dc83-4764-90ae-aed57d3f0d90 req-d03c8901-ef12-4d83-9dd6-03289e7d8e00 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received event network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0442e696-dc83-4764-90ae-aed57d3f0d90 req-d03c8901-ef12-4d83-9dd6-03289e7d8e00 service nova] Acquiring lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0442e696-dc83-4764-90ae-aed57d3f0d90 req-d03c8901-ef12-4d83-9dd6-03289e7d8e00 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0442e696-dc83-4764-90ae-aed57d3f0d90 req-d03c8901-ef12-4d83-9dd6-03289e7d8e00 service nova] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.manager [req-0442e696-dc83-4764-90ae-aed57d3f0d90 req-d03c8901-ef12-4d83-9dd6-03289e7d8e00 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] No waiting events found dispatching network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:31 user nova-compute[82617]: WARNING nova.compute.manager [req-0442e696-dc83-4764-90ae-aed57d3f0d90 req-d03c8901-ef12-4d83-9dd6-03289e7d8e00 service nova] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Received unexpected event network-vif-plugged-d1c7ec7e-3825-4422-ae8b-82505961b10d for instance with vm_state deleted and task_state None.
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:31 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Deleted allocations for instance c1fafed5-dcf8-4bac-8b38-f2067e47bd1c
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f70ef3e-ed1d-44e6-976c-1ea5835e2b71 tempest-TaggedAttachmentsTest-1309189231 tempest-TaggedAttachmentsTest-1309189231-project-member] Lock "c1fafed5-dcf8-4bac-8b38-f2067e47bd1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.197s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:31 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:27:31 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8212MB free_disk=26.528766632080078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 109c9a23-751e-4b29-abcf-0f003adb35cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:27:31 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:32 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:27:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Skipping network cache update for instance because it has been migrated to another host. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:27:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:27:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:37 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745242.3705149, ddc8a602-70e9-4697-b75b-c602ad4c2447 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:27:37 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] VM Stopped (Lifecycle Event)
Apr 17 15:27:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-c594f409-5c70-466d-ac88-3c5f1fbf2175 None None] [instance: ddc8a602-70e9-4697-b75b-c602ad4c2447] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:40 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745245.222648, edb2d74c-f1e0-4954-9ba9-812fc12562a7 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:27:40 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] VM Stopped (Lifecycle Event)
Apr 17 15:27:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9d7432f9-7376-49d4-8b1c-30a0a0d27f82 None None] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:41 user nova-compute[82617]: DEBUG nova.objects.instance [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'flavor' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:42 user nova-compute[82617]: INFO nova.compute.manager [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Attaching volume 1072d05f-2ebb-4398-902c-902df25464e9 to /dev/vdb
Apr 17 15:27:42 user nova-compute[82617]: DEBUG os_brick.utils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c747587-3c1f-4efb-b3d5-fa64d8f83705]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[721dd1da-8821-4f79-a0c0-897f81ace823]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f91dd4-d67a-4f2c-9241-b28ac2a82545]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[7695aad4-94dd-4ac4-a0ef-c25adf13efee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:27:42 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:27:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fe266f-5460-45eb-bcb6-35159dc74585]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG os_brick.utils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating existing volume attachment record: 2cb8df32-9487-4e02-8868-35c8aefceb87 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:27:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:44 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745249.3776724, c1fafed5-dcf8-4bac-8b38-f2067e47bd1c => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:27:44 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] VM Stopped (Lifecycle Event)
Apr 17 15:27:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-14ad5fbb-1712-420a-9f4d-5ae2bbba7686 None None] [instance: c1fafed5-dcf8-4bac-8b38-f2067e47bd1c] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:46 user nova-compute[82617]: DEBUG nova.objects.instance [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'flavor' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.238s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:47 user nova-compute[82617]: INFO nova.compute.manager [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Attaching volume 32819ec1-2236-465f-a1c7-ee31aa4a0911 to /dev/vdb
Apr 17 15:27:47 user nova-compute[82617]: DEBUG os_brick.utils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf18be-7dd2-4245-9485-41556749d55a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f9c74-8f52-4af7-897a-db5201def70e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4108947e-3028-44c7-8cd8-125e254e0ffe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff5af6f-004a-40d5-bb84-94d5e5b3723f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:27:47 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:27:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c503e3c3-9db6-41b5-988d-f03d0988c8a7]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG os_brick.utils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:47 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating existing volume attachment record: fb44dce3-1af2-43cf-95fa-68ff027e0699 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:48 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:48 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:48 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[31912cba-9ffc-4ee7-a94a-3ace782ed385]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:27:48 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b76471-4526-4a0c-a5f1-034598a1e329]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9] added
Apr 17 15:27:48 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746fbb4-7ffb-4f28-9acb-165bf379a567]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7960872-ca37-4948-9344-1bbb32b29cdc]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKISaVyG {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKISaVyG" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d181a5-8175-45c6-9c04-7e748c71dec4]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKISaVyG'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc920f33-c9d4-49f2-b3a5-df004da630ac]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60417b-47a1-4a96-aa3c-529103166677]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 15:27:48 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 15:27:48 user nova-compute[82617]:  {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:48 user nova-compute[82617]: WARNING os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 15:27:48 user nova-compute[82617]: 
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83caf46-4bef-425d-a899-b53bdaf081b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260]
Apr 17 15:27:48 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260] successful.
Apr 17 15:27:48 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d926242-d2bf-4f8b-80a5-d8b670b4bd20]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3efd482-9ecb-48ba-a42e-0076e3b9351f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:27:48 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:27:48 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.060s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[befc5e4e-6ad1-404b-bed0-fca0cbdd688f]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:48 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23933326166393635', 'path': '/dev/sdb'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933326166393635', 'path': '/dev/sdb'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:27:49 user nova-compute[82617]: INFO nova.compute.claims [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Claim successful on node user
Apr 17 15:27:49 user nova-compute[82617]: DEBUG nova.objects.instance [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'flavor' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:49 user nova-compute[82617]: INFO nova.compute.manager [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Unshelving
Apr 17 15:27:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 15:27:49 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:27:49 user nova-compute[82617]:   <source dev="/dev/sdb"/>
Apr 17 15:27:49 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:27:49 user nova-compute[82617]:   <serial>1072d05f-2ebb-4398-902c-902df25464e9</serial>
Apr 17 15:27:49 user nova-compute[82617]: </disk>
Apr 17 15:27:49 user nova-compute[82617]:  {{(pid=82617) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 15:27:49 user nova-compute[82617]: INFO nova.virt.block_device [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Booting with volume 13bf568b-585c-4556-ab78-e9930ad50214 at /dev/vdc
Apr 17 15:27:50 user nova-compute[82617]: DEBUG os_brick.utils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c686501-32b5-46b5-8416-2fe57e116270]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[db573139-6ff1-463e-bf3b-15b0ea37fc59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8a733d-34ec-4fbd-8449-80a0efdef796]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[be937b64-1a03-4a71-88e8-71e39768a938]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:27:50 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7a453d-6c40-4e89-9045-acde202dd34d]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG os_brick.utils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating existing volume attachment record: 1634a7d0-3313-448e-9888-8de015f268af {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.904s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] No VIF found with MAC fa:16:3e:26:9b:4e, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:27:50 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ebe6d921-be30-4631-84cb-a171f5836675 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.519s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.policy [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '795213c1e99c46a7b6dd5512b1e9f48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ca6aeb2f184cd58cf4b4dde051bdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:27:50 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Creating image(s)
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "/opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "/opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "/opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.060s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.193s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.168s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk 1073741824" returned: 0 in 0.076s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.185s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Cannot resize image /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG nova.objects.instance [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lazy-loading 'migration_context' on Instance uuid 05ccc225-01da-4975-97de-f1c0fbf20a50 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Ensure instance console log exists: /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Successfully created port: 9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:27:52 user nova-compute[82617]: INFO nova.compute.manager [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Rebuilding instance
Apr 17 15:27:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'trusted_certs' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'pci_requests' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'pci_devices' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'resources' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'migration_context' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82617) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.compute.manager [req-e5e1a7e3-04bc-46a4-837d-ef29138c7fbb req-5c79f025-fbd5-4c48-89e5-44690794e8e3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-unplugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e5e1a7e3-04bc-46a4-837d-ef29138c7fbb req-5c79f025-fbd5-4c48-89e5-44690794e8e3 service nova] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e5e1a7e3-04bc-46a4-837d-ef29138c7fbb req-5c79f025-fbd5-4c48-89e5-44690794e8e3 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e5e1a7e3-04bc-46a4-837d-ef29138c7fbb req-5c79f025-fbd5-4c48-89e5-44690794e8e3 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.compute.manager [req-e5e1a7e3-04bc-46a4-837d-ef29138c7fbb req-5c79f025-fbd5-4c48-89e5-44690794e8e3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] No waiting events found dispatching network-vif-unplugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:53 user nova-compute[82617]: WARNING nova.compute.manager [req-e5e1a7e3-04bc-46a4-837d-ef29138c7fbb req-5c79f025-fbd5-4c48-89e5-44690794e8e3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received unexpected event network-vif-unplugged-3318391f-7474-432a-ab24-5eec02673b8b for instance with vm_state active and task_state rebuilding.
Apr 17 15:27:53 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance destroyed successfully.
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Successfully updated port: 9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquired lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:27:53 user nova-compute[82617]: INFO nova.compute.manager [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Detaching volume 1072d05f-2ebb-4398-902c-902df25464e9
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:27:53 user nova-compute[82617]: INFO nova.virt.block_device [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Attempting to driver detach volume 1072d05f-2ebb-4398-902c-902df25464e9 from mountpoint /dev/vdb
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Attempting to detach device vdb from instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 from the persistent domain config. {{(pid=82617) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:27:53 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:27:53 user nova-compute[82617]:   <source dev="/dev/sdb"/>
Apr 17 15:27:53 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:27:53 user nova-compute[82617]:   <serial>1072d05f-2ebb-4398-902c-902df25464e9</serial>
Apr 17 15:27:53 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 17 15:27:53 user nova-compute[82617]: </disk>
Apr 17 15:27:53 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:27:53 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Successfully detached device vdb from instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 from the persistent domain config.
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:53 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[26153157-9918-4e4a-9b9d-66723edc5267]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:27:53 user nova-compute[82617]: No targets found.
Apr 17 15:27:53 user nova-compute[82617]: iSNS:
Apr 17 15:27:53 user nova-compute[82617]: No targets found.
Apr 17 15:27:53 user nova-compute[82617]: STATIC:
Apr 17 15:27:53 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9
Apr 17 15:27:53 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:27:53 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:27:53 user nova-compute[82617]: FIRMWARE:
Apr 17 15:27:53 user nova-compute[82617]: No targets found.
Apr 17 15:27:53 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:27:53 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:27:53 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde43487-a22e-4aa7-a7b0-f456f8dd3544]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e175a88-ece8-411a-9363-d80af90e1a84]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:27:53 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:27:53 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64906d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9'): ({'sdb'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Removing single pathed devices sdb {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae702c83-c35f-4173-98df-2670c7926082]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6e3dd4-f38a-4bc7-9380-095682000c4f]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flushing IO for device /dev/sdb {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d853956-d665-496d-879f-d46e3c6ddd14]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82617) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmhLYVJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:53 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487b78d-3d1b-4976-bd60-4b56796f5b2a]: (4, ('1', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] SCSI volumes sdb have been removed. {{(pid=82617) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9')] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80a5829-b10f-4695-9051-15023845a0cc]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --logout {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.network.neutron [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updating instance_info_cache with network_info: [{"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Releasing lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Instance network_info: |[{"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Start _get_guest_xml network_info=[{"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:27:53 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:27:53 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:27:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-473698875',display_name='tempest-TestStampPattern-server-473698875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-473698875',id=13,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpR6wTVozfzrg8ITIzsZSL0Xydku7Qt4lmPk8W4l8ULCcQqh9zp+t4PhSdrB5dj3a/e5LtbOYPXxHNSBb9u/7EwfWgkfQIl+7sCrEMiSKXHi0nmEFjdphHMWAA3ejP92w==',key_name='tempest-TestStampPattern-1190480106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9ca6aeb2f184cd58cf4b4dde051bdbb',ramdisk_id='',reservation_id='r-iabk42h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-173447269',owner_user_name='tempest-TestStampPattern-173447269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:51Z,user_data=None,user_id='795213c1e99c46a7b6dd5512b1e9f48c',uuid=05ccc225-01da-4975-97de-f1c0fbf20a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Converting VIF {"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:21:b9,bridge_name='br-int',has_traffic_filtering=True,id=9468685e-6993-4a06-b2c8-8c7388ccf0eb,network=Network(a8fac32a-80d6-4ead-8078-a99d620a3bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9468685e-69') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.objects.instance [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lazy-loading 'pci_devices' on Instance uuid 05ccc225-01da-4975-97de-f1c0fbf20a50 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a27a67-7f5c-4c2b-965a-983aaff2f19d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260]
Apr 17 15:27:54 user nova-compute[82617]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260] successful.
Apr 17 15:27:54 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op delete {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:27:54 user nova-compute[82617]:   <uuid>05ccc225-01da-4975-97de-f1c0fbf20a50</uuid>
Apr 17 15:27:54 user nova-compute[82617]:   <name>instance-0000000d</name>
Apr 17 15:27:54 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:27:54 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:27:54 user nova-compute[82617]:   <metadata>
Apr 17 15:27:54 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:27:54 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:27:54 user nova-compute[82617]:       <nova:name>tempest-TestStampPattern-server-473698875</nova:name>
Apr 17 15:27:54 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:27:53</nova:creationTime>
Apr 17 15:27:54 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:27:54 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:27:54 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:27:54 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:27:54 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:27:54 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:27:54 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:27:54 user nova-compute[82617]:       <nova:owner>
Apr 17 15:27:54 user nova-compute[82617]:         <nova:user uuid="795213c1e99c46a7b6dd5512b1e9f48c">tempest-TestStampPattern-173447269-project-member</nova:user>
Apr 17 15:27:54 user nova-compute[82617]:         <nova:project uuid="c9ca6aeb2f184cd58cf4b4dde051bdbb">tempest-TestStampPattern-173447269</nova:project>
Apr 17 15:27:54 user nova-compute[82617]:       </nova:owner>
Apr 17 15:27:54 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:27:54 user nova-compute[82617]:       <nova:ports>
Apr 17 15:27:54 user nova-compute[82617]:         <nova:port uuid="9468685e-6993-4a06-b2c8-8c7388ccf0eb">
Apr 17 15:27:54 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 15:27:54 user nova-compute[82617]:         </nova:port>
Apr 17 15:27:54 user nova-compute[82617]:       </nova:ports>
Apr 17 15:27:54 user nova-compute[82617]:     </nova:instance>
Apr 17 15:27:54 user nova-compute[82617]:   </metadata>
Apr 17 15:27:54 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:27:54 user nova-compute[82617]:     <system>
Apr 17 15:27:54 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:27:54 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:27:54 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:27:54 user nova-compute[82617]:       <entry name="serial">05ccc225-01da-4975-97de-f1c0fbf20a50</entry>
Apr 17 15:27:54 user nova-compute[82617]:       <entry name="uuid">05ccc225-01da-4975-97de-f1c0fbf20a50</entry>
Apr 17 15:27:54 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:27:54 user nova-compute[82617]:     </system>
Apr 17 15:27:54 user nova-compute[82617]:   </sysinfo>
Apr 17 15:27:54 user nova-compute[82617]:   <os>
Apr 17 15:27:54 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:27:54 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:27:54 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:27:54 user nova-compute[82617]:   </os>
Apr 17 15:27:54 user nova-compute[82617]:   <features>
Apr 17 15:27:54 user nova-compute[82617]:     <acpi/>
Apr 17 15:27:54 user nova-compute[82617]:     <apic/>
Apr 17 15:27:54 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:27:54 user nova-compute[82617]:   </features>
Apr 17 15:27:54 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:27:54 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:27:54 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:27:54 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:27:54 user nova-compute[82617]:   </clock>
Apr 17 15:27:54 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:27:54 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:27:54 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:27:54 user nova-compute[82617]:   </cpu>
Apr 17 15:27:54 user nova-compute[82617]:   <devices>
Apr 17 15:27:54 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:27:54 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:27:54 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk"/>
Apr 17 15:27:54 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:27:54 user nova-compute[82617]:     </disk>
Apr 17 15:27:54 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:27:54 user nova-compute[82617]:       <mac address="fa:16:3e:f5:21:b9"/>
Apr 17 15:27:54 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:27:54 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:27:54 user nova-compute[82617]:       <target dev="tap9468685e-69"/>
Apr 17 15:27:54 user nova-compute[82617]:     </interface>
Apr 17 15:27:54 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:27:54 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/console.log" append="off"/>
Apr 17 15:27:54 user nova-compute[82617]:     </serial>
Apr 17 15:27:54 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:27:54 user nova-compute[82617]:     <video>
Apr 17 15:27:54 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:27:54 user nova-compute[82617]:     </video>
Apr 17 15:27:54 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:27:54 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:27:54 user nova-compute[82617]:     </rng>
Apr 17 15:27:54 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:27:54 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:27:54 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:27:54 user nova-compute[82617]:     </memballoon>
Apr 17 15:27:54 user nova-compute[82617]:   </devices>
Apr 17 15:27:54 user nova-compute[82617]: </domain>
Apr 17 15:27:54 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-473698875',display_name='tempest-TestStampPattern-server-473698875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-473698875',id=13,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpR6wTVozfzrg8ITIzsZSL0Xydku7Qt4lmPk8W4l8ULCcQqh9zp+t4PhSdrB5dj3a/e5LtbOYPXxHNSBb9u/7EwfWgkfQIl+7sCrEMiSKXHi0nmEFjdphHMWAA3ejP92w==',key_name='tempest-TestStampPattern-1190480106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9ca6aeb2f184cd58cf4b4dde051bdbb',ramdisk_id='',reservation_id='r-iabk42h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-173447269',owner_user_name='tempest-TestStampPattern-173447269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:51Z,user_data=None,user_id='795213c1e99c46a7b6dd5512b1e9f48c',uuid=05ccc225-01da-4975-97de-f1c0fbf20a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Converting VIF {"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:21:b9,bridge_name='br-int',has_traffic_filtering=True,id=9468685e-6993-4a06-b2c8-8c7388ccf0eb,network=Network(a8fac32a-80d6-4ead-8078-a99d620a3bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9468685e-69') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_vif [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:21:b9,bridge_name='br-int',has_traffic_filtering=True,id=9468685e-6993-4a06-b2c8-8c7388ccf0eb,network=Network(a8fac32a-80d6-4ead-8078-a99d620a3bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9468685e-69') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9468685e-69, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9468685e-69, col_values=(('external_ids', {'iface-id': '9468685e-6993-4a06-b2c8-8c7388ccf0eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:21:b9', 'vm-uuid': '05ccc225-01da-4975-97de-f1c0fbf20a50'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d4525-a612-4819-9ede-99dbbeef01bd]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] <== disconnect_volume: return (395ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.236s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:54 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:54 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: INFO os_vif [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:21:b9,bridge_name='br-int',has_traffic_filtering=True,id=9468685e-6993-4a06-b2c8-8c7388ccf0eb,network=Network(a8fac32a-80d6-4ead-8078-a99d620a3bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9468685e-69')
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:54 user nova-compute[82617]: INFO nova.compute.manager [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Terminating instance
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[76560dea-5f6b-4112-91b4-9f85e18beb83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:27:54 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4368d10a-af1d-4b7e-a33f-a42b9a4d941f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911] added
Apr 17 15:27:54 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] No VIF found with MAC fa:16:3e:f5:21:b9, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99fef8a-c9fa-4077-b3eb-19ab6fcc14e4]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be9249-a0fb-49ba-96b0-69413cca5440]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmhLYVJy {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmhLYVJy" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5557a4f-1aaa-4cfb-b007-fb6b55146483]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CmhLYVJy'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f4bd05-b664-481e-99e3-be506cdc28fd]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f473981-ce99-464c-8cfa-b20202e8f3b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 17 15:27:54 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 17 15:27:54 user nova-compute[82617]:  {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:54 user nova-compute[82617]: WARNING os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 17 15:27:54 user nova-compute[82617]: 
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c9a6d-5fb8-4039-9ad2-7918dafbee64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911, portal: 172.16.0.220,3260]
Apr 17 15:27:54 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911, portal: 172.16.0.220,3260] successful.
Apr 17 15:27:54 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a2e7aa-70ab-41b7-a6d5-c47886bded18]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c110335a-72ad-4ad6-be2e-0bd5fa06f72f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:27:54 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:27:54 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[13591b33-53b2-4901-acb1-d627626b4f2c]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance destroyed successfully.
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1046525286',display_name='tempest-ServerActionsTestJSON-server-1900644062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1046525286',id=2,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF/iT/MoNqI4mhGgg4bOPeUaFmt+HKbeuQKnHdTMDQH/HNrNLZzsK9yPUW4qjOgGc4Pp1VwczdJXHNBz2a1NYZg13VzE5dIV1MKrnPYhhBkxvkUIIsFdmTFbdFLrQg4nw==',key_name='tempest-keypair-200176256',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb5f6b5ed2fc43b69c47e1fc18646545',ramdisk_id='',reservation_id='r-d8m8mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-645547919',owner_user_name='tempest-ServerActionsTestJSON-645547919-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='638a4f535e9740fc9d810639a5eb24d7',uuid=d109f8c3-aed3-45af-ba8d-30b9006ef4e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converting VIF {"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_vif [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3318391f-74, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:55 user nova-compute[82617]: INFO os_vif [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74')
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:55 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:27:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Instance destroyed successfully.
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.objects.instance [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lazy-loading 'resources' on Instance uuid 109c9a23-751e-4b29-abcf-0f003adb35cc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1148981178',display_name='tempest-TestVolumeSwap-server-1148981178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1148981178',id=7,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCWsWWedP45NVY6melMCfloXXhpMh5fGV6y1NN/gdT8rH9evU45A8Oua8K8r3Edrv6kDHdDvuPQPR/2WOeWraX0i/16D69tRxjdGs8XlvLGkRS3VGSvfTpsa91+XgMpw==',key_name='tempest-keypair-541289283',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00b574796d1942938ed2f348803fcf87',ramdisk_id='',reservation_id='r-o72n1m6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1714109745',owner_user_name='tempest-TestVolumeSwap-1714109745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c2bfcb4119e483ab1a41e3c598ee1b0',uuid=109c9a23-751e-4b29-abcf-0f003adb35cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Converting VIF {"id": "991a008c-046e-454f-a14c-e4a8bed88a6b", "address": "fa:16:3e:70:df:aa", "network": {"id": "90869163-2b87-480a-ab6d-d12a53663c5e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-823474759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00b574796d1942938ed2f348803fcf87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap991a008c-04", "ovs_interfaceid": "991a008c-046e-454f-a14c-e4a8bed88a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:df:aa,bridge_name='br-int',has_traffic_filtering=True,id=991a008c-046e-454f-a14c-e4a8bed88a6b,network=Network(90869163-2b87-480a-ab6d-d12a53663c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991a008c-04') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_vif [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:df:aa,bridge_name='br-int',has_traffic_filtering=True,id=991a008c-046e-454f-a14c-e4a8bed88a6b,network=Network(90869163-2b87-480a-ab6d-d12a53663c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991a008c-04') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap991a008c-04, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:55 user nova-compute[82617]: INFO os_vif [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:df:aa,bridge_name='br-int',has_traffic_filtering=True,id=991a008c-046e-454f-a14c-e4a8bed88a6b,network=Network(90869163-2b87-480a-ab6d-d12a53663c5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap991a008c-04')
Apr 17 15:27:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Deleting instance files /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc_del
Apr 17 15:27:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Deletion of /opt/stack/data/nova/instances/109c9a23-751e-4b29-abcf-0f003adb35cc_del complete
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmhLYVJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] <== connect_volume: return (1623ms) {'type': 'block', 'scsi_wwn': '26638333433313139', 'path': '/dev/sdb'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333433313139', 'path': '/dev/sdb'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.247s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:55 user nova-compute[82617]: INFO nova.compute.manager [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.objects.instance [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'flavor' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[be42f926-0256-4a40-9901-2e87b1c79891]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:27:55 user nova-compute[82617]: No targets found.
Apr 17 15:27:55 user nova-compute[82617]: iSNS:
Apr 17 15:27:55 user nova-compute[82617]: No targets found.
Apr 17 15:27:55 user nova-compute[82617]: STATIC:
Apr 17 15:27:55 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911
Apr 17 15:27:55 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:27:55 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:27:55 user nova-compute[82617]: FIRMWARE:
Apr 17 15:27:55 user nova-compute[82617]: No targets found.
Apr 17 15:27:55 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:27:55 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:27:55 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] attach device xml: <disk type="block" device="disk">
Apr 17 15:27:55 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:27:55 user nova-compute[82617]:   <source dev="/dev/sdb"/>
Apr 17 15:27:55 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:27:55 user nova-compute[82617]:   <serial>32819ec1-2236-465f-a1c7-ee31aa4a0911</serial>
Apr 17 15:27:55 user nova-compute[82617]: </disk>
Apr 17 15:27:55 user nova-compute[82617]:  {{(pid=82617) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee205b-1102-4688-a868-c36126f5b44e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ba207a-e968-4a6d-957a-9ed015f1f884]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:27:55 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:27:55 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64e7803a0>, {}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Disconnecting from: [] {{(pid=82617) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] <== disconnect_volume: return (335ms) None {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Disconnected iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 17 15:27:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Deleting instance files /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4_del
Apr 17 15:27:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Deletion of /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4_del complete
Apr 17 15:27:55 user nova-compute[82617]: INFO nova.virt.block_device [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Booting with volume 1072d05f-2ebb-4398-902c-902df25464e9 at /dev/vdb
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-changed-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Refreshing instance network info cache due to event network-changed-9468685e-6993-4a06-b2c8-8c7388ccf0eb. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Acquiring lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Acquired lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG nova.network.neutron [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Refreshing network info cache for port 9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.utils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f48cf-0cde-4d35-a5ca-c28f4b546318]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7e378-3a53-4bc9-918c-a5e975e6e494]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf79188-2a5c-45f1-988f-19418ec984f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c068cd2-b066-4002-b4cb-713fb34c11d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:27:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:27:56 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:27:56 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad5f669-35aa-4fd9-a613-6338692bc460]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG os_brick.utils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating existing volume attachment record: a68f5fc4-dea3-48a4-bdb0-1d89db356c29 {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-1dd3c7bf-9e2d-4d15-812d-72da41ab929d req-69b26546-1cc7-46ea-ad69-fd926703d19f service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1dd3c7bf-9e2d-4d15-812d-72da41ab929d req-69b26546-1cc7-46ea-ad69-fd926703d19f service nova] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1dd3c7bf-9e2d-4d15-812d-72da41ab929d req-69b26546-1cc7-46ea-ad69-fd926703d19f service nova] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1dd3c7bf-9e2d-4d15-812d-72da41ab929d req-69b26546-1cc7-46ea-ad69-fd926703d19f service nova] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-1dd3c7bf-9e2d-4d15-812d-72da41ab929d req-69b26546-1cc7-46ea-ad69-fd926703d19f service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] No waiting events found dispatching network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:56 user nova-compute[82617]: WARNING nova.compute.manager [req-1dd3c7bf-9e2d-4d15-812d-72da41ab929d req-69b26546-1cc7-46ea-ad69-fd926703d19f service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received unexpected event network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb for instance with vm_state building and task_state spawning.
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'pci_requests' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'numa_topology' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:27:56 user nova-compute[82617]: INFO nova.compute.claims [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Claim successful on node user
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No VIF found with MAC fa:16:3e:b8:22:83, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.network.neutron [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updated VIF entry in instance network info cache for port 9468685e-6993-4a06-b2c8-8c7388ccf0eb. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:27:56 user nova-compute[82617]: DEBUG nova.network.neutron [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updating instance_info_cache with network_info: [{"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Releasing lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] No waiting events found dispatching network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:57 user nova-compute[82617]: WARNING nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received unexpected event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b for instance with vm_state active and task_state rebuilding.
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received event network-vif-unplugged-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] No waiting events found dispatching network-vif-unplugged-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received event network-vif-unplugged-991a008c-046e-454f-a14c-e4a8bed88a6b for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received event network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Acquiring lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] No waiting events found dispatching network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:57 user nova-compute[82617]: WARNING nova.compute.manager [req-e7c3e4fd-b52b-4613-9cf4-c852e7985f42 req-896b8c36-4aa0-4275-97f8-c23b5911e442 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received unexpected event network-vif-plugged-991a008c-046e-454f-a14c-e4a8bed88a6b for instance with vm_state active and task_state deleting.
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-5346a9d0-f242-43c9-a311-93d0458ac4a7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.646s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:57 user nova-compute[82617]: INFO nova.network.neutron [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 17 15:27:57 user nova-compute[82617]: INFO nova.compute.manager [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Rescuing
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:57 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:27:58 user nova-compute[82617]: INFO nova.compute.claims [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Claim successful on node user
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:58 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Took 2.84 seconds to deallocate network for instance.
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-f72329f8-acc5-4e03-b716-974f57f6611d req-121ab499-b6d1-4015-a100-19f4032348b4 service nova] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Received event network-vif-deleted-991a008c-046e-454f-a14c-e4a8bed88a6b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-027f0a69-f6a9-47b6-976b-aec5cbef4581 req-4eb3e6d8-e694-4146-89eb-7919010a5044 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-027f0a69-f6a9-47b6-976b-aec5cbef4581 req-4eb3e6d8-e694-4146-89eb-7919010a5044 service nova] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-027f0a69-f6a9-47b6-976b-aec5cbef4581 req-4eb3e6d8-e694-4146-89eb-7919010a5044 service nova] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-027f0a69-f6a9-47b6-976b-aec5cbef4581 req-4eb3e6d8-e694-4146-89eb-7919010a5044 service nova] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-027f0a69-f6a9-47b6-976b-aec5cbef4581 req-4eb3e6d8-e694-4146-89eb-7919010a5044 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] No waiting events found dispatching network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:27:58 user nova-compute[82617]: WARNING nova.compute.manager [req-027f0a69-f6a9-47b6-976b-aec5cbef4581 req-4eb3e6d8-e694-4146-89eb-7919010a5044 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received unexpected event network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb for instance with vm_state building and task_state spawning.
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.322s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-5439ab5f-3b1c-46a1-ad57-5b576ffa155f req-03a79cd6-a3ad-4758-8130-bfb9730a15fa service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-changed-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-5439ab5f-3b1c-46a1-ad57-5b576ffa155f req-03a79cd6-a3ad-4758-8130-bfb9730a15fa service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Refreshing instance network info cache due to event network-changed-3ae715f2-409f-4855-94cc-3bbb6cbf1b41. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5439ab5f-3b1c-46a1-ad57-5b576ffa155f req-03a79cd6-a3ad-4758-8130-bfb9730a15fa service nova] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:27:58 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:27:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG nova.policy [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0075b26d6044a50981d29df0d863959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dd48f279404859bebcc19bcc272915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:27:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Creating image(s)
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "/opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "/opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745279.2342467, 05ccc225-01da-4975-97de-f1c0fbf20a50 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] VM Resumed (Lifecycle Event)
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Instance spawned successfully.
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.600s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745279.2348878, 05ccc225-01da-4975-97de-f1c0fbf20a50 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] VM Started (Lifecycle Event)
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Deleted allocations for instance 109c9a23-751e-4b29-abcf-0f003adb35cc
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.206s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Took 8.65 seconds to spawn the instance on the hypervisor.
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-804b1c12-2c8f-4eae-b0fb-755fcdc4d8e5 tempest-TestVolumeSwap-1714109745 tempest-TestVolumeSwap-1714109745-project-member] Lock "109c9a23-751e-4b29-abcf-0f003adb35cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.540s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.221s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.compute.manager [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Took 10.19 seconds to build instance.
Apr 17 15:27:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk 1073741824" returned: 0 in 0.099s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2e63856e-36c1-4720-95dd-43207d40474d tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.351s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:27:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Creating image(s)
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5439ab5f-3b1c-46a1-ad57-5b576ffa155f req-03a79cd6-a3ad-4758-8130-bfb9730a15fa service nova] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.network.neutron [req-5439ab5f-3b1c-46a1-ad57-5b576ffa155f req-03a79cd6-a3ad-4758-8130-bfb9730a15fa service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Refreshing network info cache for port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "c58d517b41d1ba2554adb627419ef5085ab0f550" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "c58d517b41d1ba2554adb627419ef5085ab0f550" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.181s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:27:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550.part --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Successfully created port: 18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:00 user nova-compute[82617]: WARNING nova.compute.manager [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state active and task_state rescuing.
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:00 user nova-compute[82617]: WARNING nova.compute.manager [req-7e69dd0a-0c4b-4c6e-b8b9-d788950e303a req-f445005a-6d29-4e7a-b53a-2b4e278ee31e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state active and task_state rescuing.
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.878s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Cannot resize image /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.objects.instance [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lazy-loading 'migration_context' on Instance uuid aa603d40-37aa-47b1-a289-7c7c4f582f94 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:00 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance destroyed successfully.
Apr 17 15:28:00 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Attempting a stable device rescue
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Ensure instance console log exists: /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=82617) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance directory exists: not creating {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 15:28:00 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Creating image(s)
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "96c287f73cf0bc2389118e3770917f150e54012a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "96c287f73cf0bc2389118e3770917f150e54012a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550.part --force-share --output=json" returned: 0 in 0.213s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.virt.images [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] d9191886-1044-415b-8fe4-4811959464e3 was qcow2, converting to raw {{(pid=82617) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:28:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550.part /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550.converted {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a.part --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550.part /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550.converted" returned: 0 in 1.476s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550.converted --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a.part --force-share --output=json" returned: 0 in 0.660s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:02 user nova-compute[82617]: DEBUG nova.virt.images [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] 09b4c76e-15c2-4b1c-b20a-9fbbdca7eff4 was qcow2, converting to raw {{(pid=82617) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 15:28:02 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:28:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a.part /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a.converted {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550.converted --force-share --output=json" returned: 0 in 0.480s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "c58d517b41d1ba2554adb627419ef5085ab0f550" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.199s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550 --force-share --output=json" returned: 0 in 0.225s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "c58d517b41d1ba2554adb627419ef5085ab0f550" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "c58d517b41d1ba2554adb627419ef5085ab0f550" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a.part /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a.converted" returned: 0 in 0.614s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a.converted --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550 --force-share --output=json" returned: 0 in 0.214s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550,backing_fmt=raw /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:28:03 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Creating image(s)
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550,backing_fmt=raw /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk 1073741824" returned: 0 in 0.077s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "c58d517b41d1ba2554adb627419ef5085ab0f550" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a.converted --force-share --output=json" returned: 0 in 0.305s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "96c287f73cf0bc2389118e3770917f150e54012a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.802s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "96c287f73cf0bc2389118e3770917f150e54012a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "96c287f73cf0bc2389118e3770917f150e54012a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.175s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Successfully updated port: 18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquired lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-cb52f676-b35b-4939-850d-bcc00914a9cd req-28442e50-3b04-41d1-b9d3-70e943eb0650 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received event network-changed-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-cb52f676-b35b-4939-850d-bcc00914a9cd req-28442e50-3b04-41d1-b9d3-70e943eb0650 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Refreshing instance network info cache due to event network-changed-18a1f65a-ae66-44df-8047-07b7a6ed3417. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cb52f676-b35b-4939-850d-bcc00914a9cd req-28442e50-3b04-41d1-b9d3-70e943eb0650 service nova] Acquiring lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550 --force-share --output=json" returned: 0 in 0.238s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'migration_context' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a --force-share --output=json" returned: 0 in 0.185s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a,backing_fmt=raw /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:03 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Rebasing disk image.
Apr 17 15:28:03 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-5439ab5f-3b1c-46a1-ad57-5b576ffa155f req-03a79cd6-a3ad-4758-8130-bfb9730a15fa service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updated VIF entry in instance network info cache for port 3ae715f2-409f-4855-94cc-3bbb6cbf1b41. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-5439ab5f-3b1c-46a1-ad57-5b576ffa155f req-03a79cd6-a3ad-4758-8130-bfb9730a15fa service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a,backing_fmt=raw /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.256s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "96c287f73cf0bc2389118e3770917f150e54012a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'migration_context' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5439ab5f-3b1c-46a1-ad57-5b576ffa155f req-03a79cd6-a3ad-4758-8130-bfb9730a15fa service nova] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Start _get_guest_xml network_info=[{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "vif_mac": "fa:16:3e:b8:22:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '09b4c76e-15c2-4b1c-b20a-9fbbdca7eff4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmhLYVJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fc3385ee-a569-4a45-812b-b9073d774535', 'attached_at': '', 'detached_at': '', 'volume_id': '32819ec1-2236-465f-a1c7-ee31aa4a0911', 'serial': '32819ec1-2236-465f-a1c7-ee31aa4a0911'}, 'device_type': 'disk', 'attachment_id': 'fb44dce3-1af2-43cf-95fa-68ff027e0699', 'volume_type': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'resources' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk 1073741824" returned: 0 in 0.086s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'numa_topology' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.228s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 -F raw /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:28:04 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.176s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmhLYVJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:28:04 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:28:04 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:28:04 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa0f09a-d4c0-4957-9204-dd302ea0278f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = CmhLYVJy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 17 15:28:04 user nova-compute[82617]: node.name = iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911
Apr 17 15:28:04 user nova-compute[82617]: node.tpgt = -1
Apr 17 15:28:04 user nova-compute[82617]: node.startup = automatic
Apr 17 15:28:04 user nova-compute[82617]: node.leading_login = No
Apr 17 15:28:04 user nova-compute[82617]: iface.iscsi_ifacename = default
Apr 17 15:28:04 user nova-compute[82617]: iface.net_ifacename = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.ipaddress = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.prefix_len = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.hwaddress = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.transport_name = tcp
Apr 17 15:28:04 user nova-compute[82617]: iface.initiatorname = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.state = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.vlan_id = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.vlan_priority = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.vlan_state = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.iface_num = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.mtu = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.port = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.bootproto = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.subnet_mask = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.gateway = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.dhcp_alt_client_id_state = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.dhcp_alt_client_id = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.dhcp_dns = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.dhcp_learn_iqn = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.dhcp_req_vendor_id_state = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.dhcp_vendor_id_state = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.dhcp_vendor_id = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.dhcp_slp_da = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.fragmentation = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.gratuitous_arp = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.incoming_forwarding = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.tos_state = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.tos = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.ttl = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.delayed_ack = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.tcp_nagle = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.tcp_wsf_state = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.tcp_wsf = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.tcp_timer_scale = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.tcp_timestamp = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.redirect = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.def_task_mgmt_timeout = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.header_digest = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.data_digest = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.immediate_data = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.initial_r2t = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.data_seq_inorder = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.data_pdu_inorder = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.erl = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.max_receive_data_len = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.first_burst_len = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.max_outstanding_r2t = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.max_burst_len = 0
Apr 17 15:28:04 user nova-compute[82617]: iface.chap_auth = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.bidi_chap = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.strict_login_compliance = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.discovery_auth = <empty>
Apr 17 15:28:04 user nova-compute[82617]: iface.discovery_logout = <empty>
Apr 17 15:28:04 user nova-compute[82617]: node.discovery_address = <empty>
Apr 17 15:28:04 user nova-compute[82617]: node.discovery_port = 0
Apr 17 15:28:04 user nova-compute[82617]: node.discovery_type = static
Apr 17 15:28:04 user nova-compute[82617]: node.session.initial_cmdsn = 0
Apr 17 15:28:04 user nova-compute[82617]: node.session.initial_login_retry_max = 8
Apr 17 15:28:04 user nova-compute[82617]: node.session.xmit_thread_priority = -20
Apr 17 15:28:04 user nova-compute[82617]: node.session.cmds_max = 128
Apr 17 15:28:04 user nova-compute[82617]: node.session.queue_depth = 32
Apr 17 15:28:04 user nova-compute[82617]: node.session.nr_sessions = 1
Apr 17 15:28:04 user nova-compute[82617]: node.session.auth.authmethod = CHAP
Apr 17 15:28:04 user nova-compute[82617]: node.session.auth.username = CmhLYVJy
Apr 17 15:28:04 user nova-compute[82617]: node.session.auth.password = ***
Apr 17 15:28:04 user nova-compute[82617]: node.session.auth.username_in = <empty>
Apr 17 15:28:04 user nova-compute[82617]: node.session.auth.password_in = <empty>
Apr 17 15:28:04 user nova-compute[82617]: node.session.auth.chap_algs = MD5
Apr 17 15:28:04 user nova-compute[82617]: node.session.timeo.replacement_timeout = 120
Apr 17 15:28:04 user nova-compute[82617]: node.session.err_timeo.abort_timeout = 15
Apr 17 15:28:04 user nova-compute[82617]: node.session.err_timeo.lu_reset_timeout = 30
Apr 17 15:28:04 user nova-compute[82617]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 17 15:28:04 user nova-compute[82617]: node.session.err_timeo.host_reset_timeout = 60
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.FastAbort = Yes
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.InitialR2T = No
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.ImmediateData = Yes
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.FirstBurstLength = 262144
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.MaxBurstLength = 16776192
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.DefaultTime2Retain = 0
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.DefaultTime2Wait = 2
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.MaxConnections = 1
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 17 15:28:04 user nova-compute[82617]: node.session.iscsi.ERL = 0
Apr 17 15:28:04 user nova-compute[82617]: node.session.scan = manual
Apr 17 15:28:04 user nova-compute[82617]: node.session.reopen_max = 0
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].address = 172.16.0.220
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].port = 3260
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].startup = manual
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].tcp.window_size = 524288
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].tcp.type_of_service = 0
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].timeo.logout_timeout = 15
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].timeo.login_timeout = 15
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].timeo.auth_timeout = 45
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].timeo.noop_out_interval = 5
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].timeo.noop_out_timeout = 5
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].iscsi.HeaderDigest = None
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].iscsi.DataDigest = None
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].iscsi.IFMarker = No
Apr 17 15:28:04 user nova-compute[82617]: node.conn[0].iscsi.OFMarker = No
Apr 17 15:28:04 user nova-compute[82617]: # END RECORD
Apr 17 15:28:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca06276-82f0-409c-af82-ed879ab31bd2]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c9faac-6328-42a6-9b32-764d2f48833e]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmhLYVJy {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmhLYVJy" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[86faeb05-124d-41f6-bc3c-a79cf269eb73]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CmhLYVJy'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e358a6c3-4f45-4c74-8bfd-cb4acabfaa90]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Cannot resize image /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Ensure instance console log exists: /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Start _get_guest_xml network_info=[{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd109f8c3-aed3-45af-ba8d-30b9006ef4e4', 'attached_at': '', 'detached_at': '', 'volume_id': '1072d05f-2ebb-4398-902c-902df25464e9', 'serial': '1072d05f-2ebb-4398-902c-902df25464e9'}, 'device_type': 'disk', 'attachment_id': 'a68f5fc4-dea3-48a4-bdb0-1d89db356c29', 'volume_type': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8041002-eab8-449b-8245-f1b63a41c4c3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.215s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 17 15:28:04 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'vcpu_model' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f7555-e291-4fe2-a88e-c352b722f85f]: (4, ('0 0 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmhLYVJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.264s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] <== connect_volume: return (267ms) {'type': 'block', 'scsi_wwn': '26638333433313139', 'path': '/dev/sdb'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333433313139', 'path': '/dev/sdb'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:28:04 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:28:04 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:28:04 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-765067727',display_name='tempest-ServerStableDeviceRescueTest-server-765067727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-765067727',id=3,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR2JdSi+da6BnbUL1hFO3Ku02OwrmKfJuXj9P3Ezj/X2hlOgPsocvEmY0qLTq4AOoVu5vKe2On73/43+BWss3ne+tcJcBX/XQHcOOL4ILUdxQAMJED5bkmazbJQaFRpzQ==',key_name='tempest-keypair-1194004845',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bdfb8642b9341f6ba289e920c33cf47',ramdisk_id='',reservation_id='r-dawq23oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-869290889',owner_user_name='tempest-ServerStableDeviceRescueTest-869290889-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a972c04314724233bc8e33b64747fecf',uuid=fc3385ee-a569-4a45-812b-b9073d774535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "vif_mac": "fa:16:3e:b8:22:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Converting VIF {"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "vif_mac": "fa:16:3e:b8:22:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:22:83,bridge_name='br-int',has_traffic_filtering=True,id=06c113c7-a663-47b8-a618-0a22d3e345a4,network=Network(7925f982-32fb-4fc9-b421-8dffeb064b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c113c7-a6') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'pci_devices' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3139e-8d92-4077-9b55-f73965eb4503]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:28:04 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:28:04 user nova-compute[82617]:   <uuid>fc3385ee-a569-4a45-812b-b9073d774535</uuid>
Apr 17 15:28:04 user nova-compute[82617]:   <name>instance-00000003</name>
Apr 17 15:28:04 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:28:04 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:28:04 user nova-compute[82617]:   <metadata>
Apr 17 15:28:04 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:28:04 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-765067727</nova:name>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:28:04</nova:creationTime>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:28:04 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:28:04 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:owner>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:user uuid="a972c04314724233bc8e33b64747fecf">tempest-ServerStableDeviceRescueTest-869290889-project-member</nova:user>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:project uuid="6bdfb8642b9341f6ba289e920c33cf47">tempest-ServerStableDeviceRescueTest-869290889</nova:project>
Apr 17 15:28:04 user nova-compute[82617]:       </nova:owner>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:ports>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:port uuid="06c113c7-a663-47b8-a618-0a22d3e345a4">
Apr 17 15:28:04 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 15:28:04 user nova-compute[82617]:         </nova:port>
Apr 17 15:28:04 user nova-compute[82617]:       </nova:ports>
Apr 17 15:28:04 user nova-compute[82617]:     </nova:instance>
Apr 17 15:28:04 user nova-compute[82617]:   </metadata>
Apr 17 15:28:04 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:28:04 user nova-compute[82617]:     <system>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="serial">fc3385ee-a569-4a45-812b-b9073d774535</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="uuid">fc3385ee-a569-4a45-812b-b9073d774535</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:28:04 user nova-compute[82617]:     </system>
Apr 17 15:28:04 user nova-compute[82617]:   </sysinfo>
Apr 17 15:28:04 user nova-compute[82617]:   <os>
Apr 17 15:28:04 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:28:04 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:28:04 user nova-compute[82617]:   </os>
Apr 17 15:28:04 user nova-compute[82617]:   <features>
Apr 17 15:28:04 user nova-compute[82617]:     <acpi/>
Apr 17 15:28:04 user nova-compute[82617]:     <apic/>
Apr 17 15:28:04 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:28:04 user nova-compute[82617]:   </features>
Apr 17 15:28:04 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:28:04 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:28:04 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:28:04 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:28:04 user nova-compute[82617]:   </clock>
Apr 17 15:28:04 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:28:04 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:28:04 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:28:04 user nova-compute[82617]:   </cpu>
Apr 17 15:28:04 user nova-compute[82617]:   <devices>
Apr 17 15:28:04 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:28:04 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:28:04 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk"/>
Apr 17 15:28:04 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:28:04 user nova-compute[82617]:     </disk>
Apr 17 15:28:04 user nova-compute[82617]:     <disk type="block" device="disk">
Apr 17 15:28:04 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:28:04 user nova-compute[82617]:       <source dev="/dev/sdb"/>
Apr 17 15:28:04 user nova-compute[82617]:       <target dev="vdb" bus="virtio"/>
Apr 17 15:28:04 user nova-compute[82617]:       <serial>32819ec1-2236-465f-a1c7-ee31aa4a0911</serial>
Apr 17 15:28:04 user nova-compute[82617]:     </disk>
Apr 17 15:28:04 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:28:04 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:28:04 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue"/>
Apr 17 15:28:04 user nova-compute[82617]:       <target dev="vdc" bus="virtio"/>
Apr 17 15:28:04 user nova-compute[82617]:       <boot order="1"/>
Apr 17 15:28:04 user nova-compute[82617]:     </disk>
Apr 17 15:28:04 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:28:04 user nova-compute[82617]:       <mac address="fa:16:3e:b8:22:83"/>
Apr 17 15:28:04 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:28:04 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:28:04 user nova-compute[82617]:       <target dev="tap06c113c7-a6"/>
Apr 17 15:28:04 user nova-compute[82617]:     </interface>
Apr 17 15:28:04 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:28:04 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/console.log" append="off"/>
Apr 17 15:28:04 user nova-compute[82617]:     </serial>
Apr 17 15:28:04 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:28:04 user nova-compute[82617]:     <video>
Apr 17 15:28:04 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:28:04 user nova-compute[82617]:     </video>
Apr 17 15:28:04 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:28:04 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:28:04 user nova-compute[82617]:     </rng>
Apr 17 15:28:04 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:28:04 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:28:04 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:28:04 user nova-compute[82617]:     </memballoon>
Apr 17 15:28:04 user nova-compute[82617]:   </devices>
Apr 17 15:28:04 user nova-compute[82617]: </domain>
Apr 17 15:28:04 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updating instance_info_cache with network_info: [{"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:28:04 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance destroyed successfully.
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Releasing lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Instance network_info: |[{"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cb52f676-b35b-4939-850d-bcc00914a9cd req-28442e50-3b04-41d1-b9d3-70e943eb0650 service nova] Acquired lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-cb52f676-b35b-4939-850d-bcc00914a9cd req-28442e50-3b04-41d1-b9d3-70e943eb0650 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Refreshing network info cache for port 18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Start _get_guest_xml network_info=[{"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdae48c0-6185-4907-838c-26ccc44ed7de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9] added
Apr 17 15:28:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:28:04 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1177449394',display_name='tempest-ServersNegativeTestJSON-server-1177449394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1177449394',id=14,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2dd48f279404859bebcc19bcc272915',ramdisk_id='',reservation_id='r-qd33fwol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1985071109',owner_user_name='tempest-ServersNegativeTestJSON-1985071109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:59Z,user_data=None,user_id='b0075b26d6044a50981d29df0d863959',uuid=aa603d40-37aa-47b1-a289-7c7c4f582f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converting VIF {"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a1:b2,bridge_name='br-int',has_traffic_filtering=True,id=18a1f65a-ae66-44df-8047-07b7a6ed3417,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a1f65a-ae') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.objects.instance [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lazy-loading 'pci_devices' on Instance uuid aa603d40-37aa-47b1-a289-7c7c4f582f94 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ee288e-1ad0-45e8-9bca-c81f78bb8642]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:28:04 user nova-compute[82617]:   <uuid>aa603d40-37aa-47b1-a289-7c7c4f582f94</uuid>
Apr 17 15:28:04 user nova-compute[82617]:   <name>instance-0000000e</name>
Apr 17 15:28:04 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:28:04 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:28:04 user nova-compute[82617]:   <metadata>
Apr 17 15:28:04 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:28:04 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:name>tempest-ServersNegativeTestJSON-server-1177449394</nova:name>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:28:04</nova:creationTime>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:28:04 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:28:04 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:owner>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:user uuid="b0075b26d6044a50981d29df0d863959">tempest-ServersNegativeTestJSON-1985071109-project-member</nova:user>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:project uuid="d2dd48f279404859bebcc19bcc272915">tempest-ServersNegativeTestJSON-1985071109</nova:project>
Apr 17 15:28:04 user nova-compute[82617]:       </nova:owner>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:28:04 user nova-compute[82617]:       <nova:ports>
Apr 17 15:28:04 user nova-compute[82617]:         <nova:port uuid="18a1f65a-ae66-44df-8047-07b7a6ed3417">
Apr 17 15:28:04 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 15:28:04 user nova-compute[82617]:         </nova:port>
Apr 17 15:28:04 user nova-compute[82617]:       </nova:ports>
Apr 17 15:28:04 user nova-compute[82617]:     </nova:instance>
Apr 17 15:28:04 user nova-compute[82617]:   </metadata>
Apr 17 15:28:04 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:28:04 user nova-compute[82617]:     <system>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="serial">aa603d40-37aa-47b1-a289-7c7c4f582f94</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="uuid">aa603d40-37aa-47b1-a289-7c7c4f582f94</entry>
Apr 17 15:28:04 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:28:04 user nova-compute[82617]:     </system>
Apr 17 15:28:04 user nova-compute[82617]:   </sysinfo>
Apr 17 15:28:04 user nova-compute[82617]:   <os>
Apr 17 15:28:04 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:28:04 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:28:04 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:28:04 user nova-compute[82617]:   </os>
Apr 17 15:28:04 user nova-compute[82617]:   <features>
Apr 17 15:28:04 user nova-compute[82617]:     <acpi/>
Apr 17 15:28:04 user nova-compute[82617]:     <apic/>
Apr 17 15:28:04 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:28:04 user nova-compute[82617]:   </features>
Apr 17 15:28:04 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:28:04 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:28:04 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:28:04 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:28:04 user nova-compute[82617]:   </clock>
Apr 17 15:28:04 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:28:04 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:28:04 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:28:04 user nova-compute[82617]:   </cpu>
Apr 17 15:28:04 user nova-compute[82617]:   <devices>
Apr 17 15:28:04 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:28:04 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:28:04 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk"/>
Apr 17 15:28:04 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:28:04 user nova-compute[82617]:     </disk>
Apr 17 15:28:04 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:28:04 user nova-compute[82617]:       <mac address="fa:16:3e:77:a1:b2"/>
Apr 17 15:28:04 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:28:04 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:28:04 user nova-compute[82617]:       <target dev="tap18a1f65a-ae"/>
Apr 17 15:28:04 user nova-compute[82617]:     </interface>
Apr 17 15:28:04 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:28:04 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/console.log" append="off"/>
Apr 17 15:28:04 user nova-compute[82617]:     </serial>
Apr 17 15:28:04 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:28:04 user nova-compute[82617]:     <video>
Apr 17 15:28:04 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:28:04 user nova-compute[82617]:     </video>
Apr 17 15:28:04 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:28:04 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:28:04 user nova-compute[82617]:     </rng>
Apr 17 15:28:04 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:28:04 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:28:04 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:28:04 user nova-compute[82617]:     </memballoon>
Apr 17 15:28:04 user nova-compute[82617]:   </devices>
Apr 17 15:28:04 user nova-compute[82617]: </domain>
Apr 17 15:28:04 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1177449394',display_name='tempest-ServersNegativeTestJSON-server-1177449394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1177449394',id=14,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2dd48f279404859bebcc19bcc272915',ramdisk_id='',reservation_id='r-qd33fwol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1985071109',owner_user_name='tempest-ServersNegativeTestJSON-1985071109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:59Z,user_data=None,user_id='b0075b26d6044a50981d29df0d863959',uuid=aa603d40-37aa-47b1-a289-7c7c4f582f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converting VIF {"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a1:b2,bridge_name='br-int',has_traffic_filtering=True,id=18a1f65a-ae66-44df-8047-07b7a6ed3417,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a1f65a-ae') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_vif [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a1:b2,bridge_name='br-int',has_traffic_filtering=True,id=18a1f65a-ae66-44df-8047-07b7a6ed3417,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a1f65a-ae') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18a1f65a-ae, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18a1f65a-ae, col_values=(('external_ids', {'iface-id': '18a1f65a-ae66-44df-8047-07b7a6ed3417', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:a1:b2', 'vm-uuid': 'aa603d40-37aa-47b1-a289-7c7c4f582f94'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b9f3a5-7d81-42a9-a511-7d9534f9a13e]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKISaVyG {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:04 user nova-compute[82617]: INFO os_vif [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a1:b2,bridge_name='br-int',has_traffic_filtering=True,id=18a1f65a-ae66-44df-8047-07b7a6ed3417,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a1f65a-ae')
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKISaVyG" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72560aa-3738-4412-8d00-fbc2e6e2409d]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKISaVyG'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db94d17-9c71-40c8-9ef0-e5ec8365b562]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] No VIF found with MAC fa:16:3e:b8:22:83, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91c3501-2831-40f6-aeb0-97f8ffc6815c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:04 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:28:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] No VIF found with MAC fa:16:3e:77:a1:b2, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.139s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfb6eae-dde9-4315-b772-ebfd2cb2c7fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260]
Apr 17 15:28:05 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9, portal: 172.16.0.220,3260] successful.
Apr 17 15:28:05 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d004933-67cf-493e-b171-22eb57cb51c3]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c5fd8b-7384-49f4-9ad3-9d5d924d65b6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:05 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:28:05 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:05 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:28:05 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.481s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe20335-763c-444c-a0b2-852553f0277d]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:28:05 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-cb52f676-b35b-4939-850d-bcc00914a9cd req-28442e50-3b04-41d1-b9d3-70e943eb0650 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updated VIF entry in instance network info cache for port 18a1f65a-ae66-44df-8047-07b7a6ed3417. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-cb52f676-b35b-4939-850d-bcc00914a9cd req-28442e50-3b04-41d1-b9d3-70e943eb0650 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updating instance_info_cache with network_info: [{"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cb52f676-b35b-4939-850d-bcc00914a9cd req-28442e50-3b04-41d1-b9d3-70e943eb0650 service nova] Releasing lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23933326166393635', 'path': '/dev/sdc'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933326166393635', 'path': '/dev/sdc'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T15:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1046525286',display_name='tempest-ServerActionsTestJSON-server-1900644062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1046525286',id=2,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF/iT/MoNqI4mhGgg4bOPeUaFmt+HKbeuQKnHdTMDQH/HNrNLZzsK9yPUW4qjOgGc4Pp1VwczdJXHNBz2a1NYZg13VzE5dIV1MKrnPYhhBkxvkUIIsFdmTFbdFLrQg4nw==',key_name='tempest-keypair-200176256',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb5f6b5ed2fc43b69c47e1fc18646545',ramdisk_id='',reservation_id='r-d8m8mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-645547919',owner_user_name='tempest-ServerActionsTestJSON-645547919-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='638a4f535e9740fc9d810639a5eb24d7',uuid=d109f8c3-aed3-45af-ba8d-30b9006ef4e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converting VIF {"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:28:06 user nova-compute[82617]:   <uuid>d109f8c3-aed3-45af-ba8d-30b9006ef4e4</uuid>
Apr 17 15:28:06 user nova-compute[82617]:   <name>instance-00000002</name>
Apr 17 15:28:06 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:28:06 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:28:06 user nova-compute[82617]:   <metadata>
Apr 17 15:28:06 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:28:06 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:28:06 user nova-compute[82617]:       <nova:name>tempest-ServerActionsTestJSON-server-1900644062</nova:name>
Apr 17 15:28:06 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:28:04</nova:creationTime>
Apr 17 15:28:06 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:28:06 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:28:06 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:28:06 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:28:06 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:28:06 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:28:06 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:28:06 user nova-compute[82617]:       <nova:owner>
Apr 17 15:28:06 user nova-compute[82617]:         <nova:user uuid="638a4f535e9740fc9d810639a5eb24d7">tempest-ServerActionsTestJSON-645547919-project-member</nova:user>
Apr 17 15:28:06 user nova-compute[82617]:         <nova:project uuid="cb5f6b5ed2fc43b69c47e1fc18646545">tempest-ServerActionsTestJSON-645547919</nova:project>
Apr 17 15:28:06 user nova-compute[82617]:       </nova:owner>
Apr 17 15:28:06 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:28:06 user nova-compute[82617]:       <nova:ports>
Apr 17 15:28:06 user nova-compute[82617]:         <nova:port uuid="3318391f-7474-432a-ab24-5eec02673b8b">
Apr 17 15:28:06 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 17 15:28:06 user nova-compute[82617]:         </nova:port>
Apr 17 15:28:06 user nova-compute[82617]:       </nova:ports>
Apr 17 15:28:06 user nova-compute[82617]:     </nova:instance>
Apr 17 15:28:06 user nova-compute[82617]:   </metadata>
Apr 17 15:28:06 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:28:06 user nova-compute[82617]:     <system>
Apr 17 15:28:06 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:28:06 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:28:06 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:28:06 user nova-compute[82617]:       <entry name="serial">d109f8c3-aed3-45af-ba8d-30b9006ef4e4</entry>
Apr 17 15:28:06 user nova-compute[82617]:       <entry name="uuid">d109f8c3-aed3-45af-ba8d-30b9006ef4e4</entry>
Apr 17 15:28:06 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:28:06 user nova-compute[82617]:     </system>
Apr 17 15:28:06 user nova-compute[82617]:   </sysinfo>
Apr 17 15:28:06 user nova-compute[82617]:   <os>
Apr 17 15:28:06 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:28:06 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:28:06 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:28:06 user nova-compute[82617]:   </os>
Apr 17 15:28:06 user nova-compute[82617]:   <features>
Apr 17 15:28:06 user nova-compute[82617]:     <acpi/>
Apr 17 15:28:06 user nova-compute[82617]:     <apic/>
Apr 17 15:28:06 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:28:06 user nova-compute[82617]:   </features>
Apr 17 15:28:06 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:28:06 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:28:06 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:28:06 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:28:06 user nova-compute[82617]:   </clock>
Apr 17 15:28:06 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:28:06 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:28:06 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:28:06 user nova-compute[82617]:   </cpu>
Apr 17 15:28:06 user nova-compute[82617]:   <devices>
Apr 17 15:28:06 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:28:06 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:28:06 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk"/>
Apr 17 15:28:06 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:28:06 user nova-compute[82617]:     </disk>
Apr 17 15:28:06 user nova-compute[82617]:     <disk type="block" device="disk">
Apr 17 15:28:06 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:28:06 user nova-compute[82617]:       <source dev="/dev/sdc"/>
Apr 17 15:28:06 user nova-compute[82617]:       <target dev="vdb" bus="virtio"/>
Apr 17 15:28:06 user nova-compute[82617]:       <serial>1072d05f-2ebb-4398-902c-902df25464e9</serial>
Apr 17 15:28:06 user nova-compute[82617]:     </disk>
Apr 17 15:28:06 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:28:06 user nova-compute[82617]:       <mac address="fa:16:3e:26:9b:4e"/>
Apr 17 15:28:06 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:28:06 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:28:06 user nova-compute[82617]:       <target dev="tap3318391f-74"/>
Apr 17 15:28:06 user nova-compute[82617]:     </interface>
Apr 17 15:28:06 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:28:06 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/console.log" append="off"/>
Apr 17 15:28:06 user nova-compute[82617]:     </serial>
Apr 17 15:28:06 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:28:06 user nova-compute[82617]:     <video>
Apr 17 15:28:06 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:28:06 user nova-compute[82617]:     </video>
Apr 17 15:28:06 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:28:06 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:28:06 user nova-compute[82617]:     </rng>
Apr 17 15:28:06 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:28:06 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:28:06 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:28:06 user nova-compute[82617]:     </memballoon>
Apr 17 15:28:06 user nova-compute[82617]:   </devices>
Apr 17 15:28:06 user nova-compute[82617]: </domain>
Apr 17 15:28:06 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T15:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1046525286',display_name='tempest-ServerActionsTestJSON-server-1900644062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1046525286',id=2,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF/iT/MoNqI4mhGgg4bOPeUaFmt+HKbeuQKnHdTMDQH/HNrNLZzsK9yPUW4qjOgGc4Pp1VwczdJXHNBz2a1NYZg13VzE5dIV1MKrnPYhhBkxvkUIIsFdmTFbdFLrQg4nw==',key_name='tempest-keypair-200176256',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb5f6b5ed2fc43b69c47e1fc18646545',ramdisk_id='',reservation_id='r-d8m8mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-645547919',owner_user_name='tempest-ServerActionsTestJSON-645547919-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='638a4f535e9740fc9d810639a5eb24d7',uuid=d109f8c3-aed3-45af-ba8d-30b9006ef4e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converting VIF {"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG os_vif [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3318391f-74, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3318391f-74, col_values=(('external_ids', {'iface-id': '3318391f-7474-432a-ab24-5eec02673b8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:9b:4e', 'vm-uuid': 'd109f8c3-aed3-45af-ba8d-30b9006ef4e4'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:06 user nova-compute[82617]: INFO os_vif [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74')
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:28:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] No VIF found with MAC fa:16:3e:26:9b:4e, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 -F raw /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk" returned: 0 in 3.120s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Ensure instance console log exists: /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Start _get_guest_xml network_info=[{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cb699c6b1f40676327e2344bfcba896e',container_format='bare',created_at=2023-04-17T15:25:56Z,direct_url=<?>,disk_format='qcow2',id=d9191886-1044-415b-8fe4-4811959464e3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-474197410-shelved',owner='214a0f233f114d7aa22e64048a837c0b',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-17T15:26:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajgFQvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6aab9803-ab51-47c6-a2a2-739a7a18f5dc', 'attached_at': '', 'detached_at': '', 'volume_id': '13bf568b-585c-4556-ab78-e9930ad50214', 'serial': '13bf568b-585c-4556-ab78-e9930ad50214'}, 'device_type': 'disk', 'attachment_id': '1634a7d0-3313-448e-9888-8de015f268af', 'volume_type': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:28:07 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:28:07 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cb699c6b1f40676327e2344bfcba896e',container_format='bare',created_at=2023-04-17T15:25:56Z,direct_url=<?>,disk_format='qcow2',id=d9191886-1044-415b-8fe4-4811959464e3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-474197410-shelved',owner='214a0f233f114d7aa22e64048a837c0b',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-17T15:26:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Calling os-brick to attach iSCSI Volume {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajgFQvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:28:07 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:28:07 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:28:07 user nova-compute[82617]: INFO os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ed4df6-7102-4801-93a6-795c5fa04c6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 17 15:28:07 user nova-compute[82617]:  {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --interface default --op new {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[e213c275-1229-42f8-8160-657d8c671a69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214] added\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214] added
Apr 17 15:28:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[58403aee-e7f0-41ae-b32b-2a8e2bd428ba]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d8e563-13b3-4723-a646-98ba1ca91d67]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cajgFQvq {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cajgFQvq" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c429562-8a64-4c99-82ad-2c394730ede8]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cajgFQvq'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6013df-3e2c-4b00-8b55-f70761b278ed]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f8fabc-bbec-4687-8b22-ddf09cbf9e41]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --login {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02414f6-fadb-4f42-a2ca-a5ab783e0704]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214, portal: 172.16.0.220,3260]
Apr 17 15:28:07 user nova-compute[82617]: Login to [iface: default, target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214, portal: 172.16.0.220,3260] successful.
Apr 17 15:28:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.066s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72597ba-417d-48cb-ad92-66fc3fc9db04]: (4, ('', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82617) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[99706946-8d99-4fb0-bccf-2a26857b2002]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 15:28:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Connected to 172.16.0.220:3260 {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=82617) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82617) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c100359b-28ef-4c2d-b0a2-95e40da1c900]: (4, ('- - 0', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82617) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 17 15:28:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajgFQvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82617) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745273.3540857, d109f8c3-aed3-45af-ba8d-30b9006ef4e4 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:08 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] VM Stopped (Lifecycle Event)
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-f6c72984-d236-430e-9d69-203e157f735e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26431616337386434', 'path': '/dev/sdd'} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431616337386434', 'path': '/dev/sdd'} {{(pid=82617) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T15:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-474197410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-474197410',id=4,image_ref='d9191886-1044-415b-8fe4-4811959464e3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1690039047',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-qleldwb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member',shelved_at='2023-04-17T15:25:59.963878',shelved_host='user',shelved_image_id='d9191886-1044-415b-8fe4-4811959464e3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=6aab9803-ab51-47c6-a2a2-739a7a18f5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:28:08 user nova-compute[82617]:   <uuid>6aab9803-ab51-47c6-a2a2-739a7a18f5dc</uuid>
Apr 17 15:28:08 user nova-compute[82617]:   <name>instance-00000004</name>
Apr 17 15:28:08 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:28:08 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:28:08 user nova-compute[82617]:   <metadata>
Apr 17 15:28:08 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:28:08 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:28:08 user nova-compute[82617]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-474197410</nova:name>
Apr 17 15:28:08 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:28:07</nova:creationTime>
Apr 17 15:28:08 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:28:08 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:28:08 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:28:08 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:28:08 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:28:08 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:28:08 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:28:08 user nova-compute[82617]:       <nova:owner>
Apr 17 15:28:08 user nova-compute[82617]:         <nova:user uuid="83b9d77de46143d8b9277a55f5ad4d72">tempest-AttachVolumeShelveTestJSON-1745617049-project-member</nova:user>
Apr 17 15:28:08 user nova-compute[82617]:         <nova:project uuid="214a0f233f114d7aa22e64048a837c0b">tempest-AttachVolumeShelveTestJSON-1745617049</nova:project>
Apr 17 15:28:08 user nova-compute[82617]:       </nova:owner>
Apr 17 15:28:08 user nova-compute[82617]:       <nova:root type="image" uuid="d9191886-1044-415b-8fe4-4811959464e3"/>
Apr 17 15:28:08 user nova-compute[82617]:       <nova:ports>
Apr 17 15:28:08 user nova-compute[82617]:         <nova:port uuid="3ae715f2-409f-4855-94cc-3bbb6cbf1b41">
Apr 17 15:28:08 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 15:28:08 user nova-compute[82617]:         </nova:port>
Apr 17 15:28:08 user nova-compute[82617]:       </nova:ports>
Apr 17 15:28:08 user nova-compute[82617]:     </nova:instance>
Apr 17 15:28:08 user nova-compute[82617]:   </metadata>
Apr 17 15:28:08 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:28:08 user nova-compute[82617]:     <system>
Apr 17 15:28:08 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:28:08 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:28:08 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:28:08 user nova-compute[82617]:       <entry name="serial">6aab9803-ab51-47c6-a2a2-739a7a18f5dc</entry>
Apr 17 15:28:08 user nova-compute[82617]:       <entry name="uuid">6aab9803-ab51-47c6-a2a2-739a7a18f5dc</entry>
Apr 17 15:28:08 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:28:08 user nova-compute[82617]:     </system>
Apr 17 15:28:08 user nova-compute[82617]:   </sysinfo>
Apr 17 15:28:08 user nova-compute[82617]:   <os>
Apr 17 15:28:08 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:28:08 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:28:08 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:28:08 user nova-compute[82617]:   </os>
Apr 17 15:28:08 user nova-compute[82617]:   <features>
Apr 17 15:28:08 user nova-compute[82617]:     <acpi/>
Apr 17 15:28:08 user nova-compute[82617]:     <apic/>
Apr 17 15:28:08 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:28:08 user nova-compute[82617]:   </features>
Apr 17 15:28:08 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:28:08 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:28:08 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:28:08 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:28:08 user nova-compute[82617]:   </clock>
Apr 17 15:28:08 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:28:08 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:28:08 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:28:08 user nova-compute[82617]:   </cpu>
Apr 17 15:28:08 user nova-compute[82617]:   <devices>
Apr 17 15:28:08 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:28:08 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:28:08 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk"/>
Apr 17 15:28:08 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:28:08 user nova-compute[82617]:     </disk>
Apr 17 15:28:08 user nova-compute[82617]:     <disk type="block" device="disk">
Apr 17 15:28:08 user nova-compute[82617]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:28:08 user nova-compute[82617]:       <source dev="/dev/sdd"/>
Apr 17 15:28:08 user nova-compute[82617]:       <target dev="vdc" bus="virtio"/>
Apr 17 15:28:08 user nova-compute[82617]:       <serial>13bf568b-585c-4556-ab78-e9930ad50214</serial>
Apr 17 15:28:08 user nova-compute[82617]:     </disk>
Apr 17 15:28:08 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:28:08 user nova-compute[82617]:       <mac address="fa:16:3e:9a:66:02"/>
Apr 17 15:28:08 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:28:08 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:28:08 user nova-compute[82617]:       <target dev="tap3ae715f2-40"/>
Apr 17 15:28:08 user nova-compute[82617]:     </interface>
Apr 17 15:28:08 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:28:08 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/console.log" append="off"/>
Apr 17 15:28:08 user nova-compute[82617]:     </serial>
Apr 17 15:28:08 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:28:08 user nova-compute[82617]:     <video>
Apr 17 15:28:08 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:28:08 user nova-compute[82617]:     </video>
Apr 17 15:28:08 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:28:08 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:28:08 user nova-compute[82617]:     </rng>
Apr 17 15:28:08 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:28:08 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:28:08 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:28:08 user nova-compute[82617]:     </memballoon>
Apr 17 15:28:08 user nova-compute[82617]:   </devices>
Apr 17 15:28:08 user nova-compute[82617]: </domain>
Apr 17 15:28:08 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T15:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-474197410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-474197410',id=4,image_ref='d9191886-1044-415b-8fe4-4811959464e3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1690039047',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-qleldwb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member',shelved_at='2023-04-17T15:25:59.963878',shelved_host='user',shelved_image_id='d9191886-1044-415b-8fe4-4811959464e3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=6aab9803-ab51-47c6-a2a2-739a7a18f5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG os_vif [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ae715f2-40, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ae715f2-40, col_values=(('external_ids', {'iface-id': '3ae715f2-409f-4855-94cc-3bbb6cbf1b41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:66:02', 'vm-uuid': '6aab9803-ab51-47c6-a2a2-739a7a18f5dc'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:28:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:09 user nova-compute[82617]: INFO os_vif [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40')
Apr 17 15:28:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-22b7c22a-6338-414e-9b99-a141ebeff428 req-63b09327-4b6f-4af4-962c-3414e50a8104 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-22b7c22a-6338-414e-9b99-a141ebeff428 req-63b09327-4b6f-4af4-962c-3414e50a8104 service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-22b7c22a-6338-414e-9b99-a141ebeff428 req-63b09327-4b6f-4af4-962c-3414e50a8104 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-22b7c22a-6338-414e-9b99-a141ebeff428 req-63b09327-4b6f-4af4-962c-3414e50a8104 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-22b7c22a-6338-414e-9b99-a141ebeff428 req-63b09327-4b6f-4af4-962c-3414e50a8104 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:10 user nova-compute[82617]: WARNING nova.compute.manager [req-22b7c22a-6338-414e-9b99-a141ebeff428 req-63b09327-4b6f-4af4-962c-3414e50a8104 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state active and task_state rescuing.
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745275.3386018, 109c9a23-751e-4b29-abcf-0f003adb35cc => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:10 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] VM Stopped (Lifecycle Event)
Apr 17 15:28:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-831f6f02-b15f-4d84-9c91-9d76f711a40d None None] [instance: 109c9a23-751e-4b29-abcf-0f003adb35cc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:28:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:28:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] No VIF found with MAC fa:16:3e:9a:66:02, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:12 user nova-compute[82617]: WARNING nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state active and task_state rescuing.
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] No waiting events found dispatching network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:12 user nova-compute[82617]: WARNING nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received unexpected event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b for instance with vm_state active and task_state rebuild_spawning.
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] No waiting events found dispatching network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:12 user nova-compute[82617]: WARNING nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received unexpected event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b for instance with vm_state active and task_state rebuild_spawning.
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received event network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] No waiting events found dispatching network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:12 user nova-compute[82617]: WARNING nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received unexpected event network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 for instance with vm_state building and task_state spawning.
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received event network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] No waiting events found dispatching network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:12 user nova-compute[82617]: WARNING nova.compute.manager [req-07045358-4910-46c4-a6d1-735d157154db req-b3fded60-4df6-43ff-8f4a-850c906777b3 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received unexpected event network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 for instance with vm_state building and task_state spawning.
Apr 17 15:28:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-cf94e49d-5cd0-446b-aead-85773afd2529 req-351ef6f1-dd98-449c-9fe3-81a16d1c4010 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cf94e49d-5cd0-446b-aead-85773afd2529 req-351ef6f1-dd98-449c-9fe3-81a16d1c4010 service nova] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cf94e49d-5cd0-446b-aead-85773afd2529 req-351ef6f1-dd98-449c-9fe3-81a16d1c4010 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cf94e49d-5cd0-446b-aead-85773afd2529 req-351ef6f1-dd98-449c-9fe3-81a16d1c4010 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-cf94e49d-5cd0-446b-aead-85773afd2529 req-351ef6f1-dd98-449c-9fe3-81a16d1c4010 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] No waiting events found dispatching network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:13 user nova-compute[82617]: WARNING nova.compute.manager [req-cf94e49d-5cd0-446b-aead-85773afd2529 req-351ef6f1-dd98-449c-9fe3-81a16d1c4010 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received unexpected event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 17 15:28:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Removed pending event for fc3385ee-a569-4a45-812b-b9073d774535 due to event {{(pid=82617) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745294.050241, fc3385ee-a569-4a45-812b-b9073d774535 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] VM Resumed (Lifecycle Event)
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b2934d3a-18ae-4bf7-b347-da2309e65f18 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Instance spawned successfully.
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745294.0576138, fc3385ee-a569-4a45-812b-b9073d774535 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] VM Started (Lifecycle Event)
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance spawned successfully.
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745294.059597, aa603d40-37aa-47b1-a289-7c7c4f582f94 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] VM Resumed (Lifecycle Event)
Apr 17 15:28:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745294.0623207, aa603d40-37aa-47b1-a289-7c7c4f582f94 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] VM Started (Lifecycle Event)
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Took 15.16 seconds to spawn the instance on the hypervisor.
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745294.162814, d109f8c3-aed3-45af-ba8d-30b9006ef4e4 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] VM Resumed (Lifecycle Event)
Apr 17 15:28:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.objects.instance [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82617) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Took 16.36 seconds to build instance.
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745294.164212, d109f8c3-aed3-45af-ba8d-30b9006ef4e4 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:14 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] VM Started (Lifecycle Event)
Apr 17 15:28:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8f71fb0d-ca64-4265-a31d-06d0b5a1e156 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.514s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:28:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-6c844c62-e6e1-4124-88a9-31cd15b5f835 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.153s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-1f15d9c4-8a35-4cfc-98b7-88393bb4fc5d req-dd7a1009-9a55-464a-81fd-d73e990564d6 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:28:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1f15d9c4-8a35-4cfc-98b7-88393bb4fc5d req-dd7a1009-9a55-464a-81fd-d73e990564d6 service nova] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1f15d9c4-8a35-4cfc-98b7-88393bb4fc5d req-dd7a1009-9a55-464a-81fd-d73e990564d6 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-1f15d9c4-8a35-4cfc-98b7-88393bb4fc5d req-dd7a1009-9a55-464a-81fd-d73e990564d6 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-1f15d9c4-8a35-4cfc-98b7-88393bb4fc5d req-dd7a1009-9a55-464a-81fd-d73e990564d6 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] No waiting events found dispatching network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:28:15 user nova-compute[82617]: WARNING nova.compute.manager [req-1f15d9c4-8a35-4cfc-98b7-88393bb4fc5d req-dd7a1009-9a55-464a-81fd-d73e990564d6 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received unexpected event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745296.1130764, 6aab9803-ab51-47c6-a2a2-739a7a18f5dc => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:16 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] VM Resumed (Lifecycle Event)
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:16 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance spawned successfully.
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:28:16 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745296.1178653, 6aab9803-ab51-47c6-a2a2-739a7a18f5dc => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:28:16 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] VM Started (Lifecycle Event)
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:28:16 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:28:16 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:28:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b474c39e-ef83-4b0a-868f-b4857ff3294d tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.991s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:28:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:28:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:28:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:28:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7812MB free_disk=26.448650360107422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05ccc225-01da-4975-97de-f1c0fbf20a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:28:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:28:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:28:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:28:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:28:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:28:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:28:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:28:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:28:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:29:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:29:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Acquiring lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:16 user nova-compute[82617]: INFO nova.compute.manager [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Unshelving
Apr 17 15:29:16 user nova-compute[82617]: INFO nova.virt.block_device [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Booting with volume d895d11d-6880-4418-a9ad-feca813ed5d6 at /dev/vda
Apr 17 15:29:16 user nova-compute[82617]: DEBUG os_brick.utils [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b3917-da34-4083-a4a0-e0a1223d8a63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.034s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e197ac-85db-445b-91e9-b7649a300d23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b327dc0-0ee4-441c-a056-84c044395586]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e9100-cb0d-4357-a062-cf4597330fe8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:29:16 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:29:16 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2be5587-e504-4771-ba31-0d03eb5f18e0]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG os_brick.utils [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:29:16 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Updating existing volume attachment record: 9b0bf9c4-9b18-4c4d-9466-e0dd3f87e23d {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:29:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:29:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:29:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:29:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:29:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:29:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7854MB free_disk=26.445343017578125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05ccc225-01da-4975-97de-f1c0fbf20a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updating instance_info_cache with network_info: [{"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 15:29:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 15:29:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 15:29:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:29:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:29:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG nova.compute.manager [req-f1c9a08e-21cf-48f4-b4d8-556ffd4ff9a2 req-bc339d74-2571-4eb4-9ef4-da7b847fdd9f service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-changed-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG nova.compute.manager [req-f1c9a08e-21cf-48f4-b4d8-556ffd4ff9a2 req-bc339d74-2571-4eb4-9ef4-da7b847fdd9f service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Refreshing instance network info cache due to event network-changed-9468685e-6993-4a06-b2c8-8c7388ccf0eb. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f1c9a08e-21cf-48f4-b4d8-556ffd4ff9a2 req-bc339d74-2571-4eb4-9ef4-da7b847fdd9f service nova] Acquiring lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f1c9a08e-21cf-48f4-b4d8-556ffd4ff9a2 req-bc339d74-2571-4eb4-9ef4-da7b847fdd9f service nova] Acquired lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG nova.network.neutron [req-f1c9a08e-21cf-48f4-b4d8-556ffd4ff9a2 req-bc339d74-2571-4eb4-9ef4-da7b847fdd9f service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Refreshing network info cache for port 9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG nova.objects.instance [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lazy-loading 'flavor' on Instance uuid 05ccc225-01da-4975-97de-f1c0fbf20a50 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:41 user nova-compute[82617]: INFO nova.compute.manager [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Attaching volume a9c177a1-61f0-4201-bb8d-7f18c9af396c to /dev/vdb
Apr 17 15:29:41 user nova-compute[82617]: DEBUG os_brick.utils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[83783598-ce58-4b5a-93bc-62452cba6bbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b55ce9acc74\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[092038fa-1532-4f72-9706-b28dd654eb7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[adccc81b-c6fa-4e83-934a-242a19202228]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae7ae8-aa8e-497c-bb7e-e2410c914262]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Running cmd (subprocess): nvme version {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] 'nvme version' failed. Not Retrying. {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG nova.network.neutron [req-f1c9a08e-21cf-48f4-b4d8-556ffd4ff9a2 req-bc339d74-2571-4eb4-9ef4-da7b847fdd9f service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updated VIF entry in instance network info cache for port 9468685e-6993-4a06-b2c8-8c7388ccf0eb. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG nova.network.neutron [req-f1c9a08e-21cf-48f4-b4d8-556ffd4ff9a2 req-bc339d74-2571-4eb4-9ef4-da7b847fdd9f service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updating instance_info_cache with network_info: [{"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] nvme not present on system {{(pid=82617) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:29:42 user nova-compute[82617]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[377b9d53-0664-4881-b746-cd80460f183b]: (4, '') {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82617) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.lightos [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] LIGHTOS: no hostnqn found. {{(pid=82617) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG os_brick.utils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b55ce9acc74', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG nova.virt.block_device [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updating existing volume attachment record: f92396df-2a76-4bb0-9a46-97760ba2708a {{(pid=82617) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 17 15:29:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f1c9a08e-21cf-48f4-b4d8-556ffd4ff9a2 req-bc339d74-2571-4eb4-9ef4-da7b847fdd9f service nova] Releasing lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid df469608-5f17-4f70-8933-fe92adcd3837 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid c0e53ff8-38c3-4353-a225-22ceae908f50 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 05ccc225-01da-4975-97de-f1c0fbf20a50 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid aa603d40-37aa-47b1-a289-7c7c4f582f94 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "df469608-5f17-4f70-8933-fe92adcd3837" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "c0e53ff8-38c3-4353-a225-22ceae908f50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "df469608-5f17-4f70-8933-fe92adcd3837" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:48 user nova-compute[82617]: INFO nova.compute.manager [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Unrescuing
Apr 17 15:29:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:29:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:29:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "66369a14-9c32-49ed-95b0-f02558081f99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "66369a14-9c32-49ed-95b0-f02558081f99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:29:49 user nova-compute[82617]: INFO nova.compute.claims [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Claim successful on node user
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.network.neutron [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.objects.instance [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'flavor' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:29:49 user nova-compute[82617]: DEBUG nova.network.neutron [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:29:50 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.policy [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0075b26d6044a50981d29df0d863959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dd48f279404859bebcc19bcc272915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:29:50 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Creating image(s)
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "/opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "/opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "/opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-489b8729-b8d1-464c-b631-14f0b468a702 req-b944419f-5f38-43bc-975d-4ca7f255b091 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.compute.manager [req-489b8729-b8d1-464c-b631-14f0b468a702 req-b944419f-5f38-43bc-975d-4ca7f255b091 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing instance network info cache due to event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-489b8729-b8d1-464c-b631-14f0b468a702 req-b944419f-5f38-43bc-975d-4ca7f255b091 service nova] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-489b8729-b8d1-464c-b631-14f0b468a702 req-b944419f-5f38-43bc-975d-4ca7f255b091 service nova] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.network.neutron [req-489b8729-b8d1-464c-b631-14f0b468a702 req-b944419f-5f38-43bc-975d-4ca7f255b091 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk 1073741824" returned: 0 in 0.055s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Cannot resize image /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.objects.instance [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lazy-loading 'migration_context' on Instance uuid 66369a14-9c32-49ed-95b0-f02558081f99 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Ensure instance console log exists: /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:51 user nova-compute[82617]: DEBUG nova.network.neutron [req-489b8729-b8d1-464c-b631-14f0b468a702 req-b944419f-5f38-43bc-975d-4ca7f255b091 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated VIF entry in instance network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:29:51 user nova-compute[82617]: DEBUG nova.network.neutron [req-489b8729-b8d1-464c-b631-14f0b468a702 req-b944419f-5f38-43bc-975d-4ca7f255b091 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:29:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-489b8729-b8d1-464c-b631-14f0b468a702 req-b944419f-5f38-43bc-975d-4ca7f255b091 service nova] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:29:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:51 user nova-compute[82617]: DEBUG nova.network.neutron [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Successfully created port: 4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Successfully updated port: 4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "refresh_cache-66369a14-9c32-49ed-95b0-f02558081f99" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquired lock "refresh_cache-66369a14-9c32-49ed-95b0-f02558081f99" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-0f5edc85-ef78-4657-a6c6-c7e4d8a181e8 req-2c878124-3dee-47e0-b795-baba7b16fa33 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received event network-changed-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-0f5edc85-ef78-4657-a6c6-c7e4d8a181e8 req-2c878124-3dee-47e0-b795-baba7b16fa33 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Refreshing instance network info cache due to event network-changed-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0f5edc85-ef78-4657-a6c6-c7e4d8a181e8 req-2c878124-3dee-47e0-b795-baba7b16fa33 service nova] Acquiring lock "refresh_cache-66369a14-9c32-49ed-95b0-f02558081f99" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-71478c17-1095-4616-a726-3514d7c56d00 req-410d8abe-05c5-49f3-b06f-751f25f1b95c service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-71478c17-1095-4616-a726-3514d7c56d00 req-410d8abe-05c5-49f3-b06f-751f25f1b95c service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing instance network info cache due to event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-71478c17-1095-4616-a726-3514d7c56d00 req-410d8abe-05c5-49f3-b06f-751f25f1b95c service nova] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-71478c17-1095-4616-a726-3514d7c56d00 req-410d8abe-05c5-49f3-b06f-751f25f1b95c service nova] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.neutron [req-71478c17-1095-4616-a726-3514d7c56d00 req-410d8abe-05c5-49f3-b06f-751f25f1b95c service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Updating instance_info_cache with network_info: [{"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Releasing lock "refresh_cache-66369a14-9c32-49ed-95b0-f02558081f99" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Instance network_info: |[{"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0f5edc85-ef78-4657-a6c6-c7e4d8a181e8 req-2c878124-3dee-47e0-b795-baba7b16fa33 service nova] Acquired lock "refresh_cache-66369a14-9c32-49ed-95b0-f02558081f99" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.neutron [req-0f5edc85-ef78-4657-a6c6-c7e4d8a181e8 req-2c878124-3dee-47e0-b795-baba7b16fa33 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Refreshing network info cache for port 4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Start _get_guest_xml network_info=[{"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:29:52 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:29:52 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1105673637',display_name='tempest-ServersNegativeTestJSON-server-1105673637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1105673637',id=15,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2dd48f279404859bebcc19bcc272915',ramdisk_id='',reservation_id='r-l2o14muk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1985071109',owner_user_name='tempest-ServersNegativeTestJSON-1985071109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:29:50Z,user_data=None,user_id='b0075b26d6044a50981d29df0d863959',uuid=66369a14-9c32-49ed-95b0-f02558081f99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converting VIF {"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:e8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f4c19-2c4d-42a0-b8db-a2debaa63fec,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f4c19-2c') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lazy-loading 'pci_devices' on Instance uuid 66369a14-9c32-49ed-95b0-f02558081f99 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:29:52 user nova-compute[82617]:   <uuid>66369a14-9c32-49ed-95b0-f02558081f99</uuid>
Apr 17 15:29:52 user nova-compute[82617]:   <name>instance-0000000f</name>
Apr 17 15:29:52 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:29:52 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:29:52 user nova-compute[82617]:   <metadata>
Apr 17 15:29:52 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:29:52 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:29:52 user nova-compute[82617]:       <nova:name>tempest-ServersNegativeTestJSON-server-1105673637</nova:name>
Apr 17 15:29:52 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:29:52</nova:creationTime>
Apr 17 15:29:52 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:29:52 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:29:52 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:29:52 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:29:52 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:29:52 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:29:52 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:29:52 user nova-compute[82617]:       <nova:owner>
Apr 17 15:29:52 user nova-compute[82617]:         <nova:user uuid="b0075b26d6044a50981d29df0d863959">tempest-ServersNegativeTestJSON-1985071109-project-member</nova:user>
Apr 17 15:29:52 user nova-compute[82617]:         <nova:project uuid="d2dd48f279404859bebcc19bcc272915">tempest-ServersNegativeTestJSON-1985071109</nova:project>
Apr 17 15:29:52 user nova-compute[82617]:       </nova:owner>
Apr 17 15:29:52 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:29:52 user nova-compute[82617]:       <nova:ports>
Apr 17 15:29:52 user nova-compute[82617]:         <nova:port uuid="4b5f4c19-2c4d-42a0-b8db-a2debaa63fec">
Apr 17 15:29:52 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 17 15:29:52 user nova-compute[82617]:         </nova:port>
Apr 17 15:29:52 user nova-compute[82617]:       </nova:ports>
Apr 17 15:29:52 user nova-compute[82617]:     </nova:instance>
Apr 17 15:29:52 user nova-compute[82617]:   </metadata>
Apr 17 15:29:52 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:29:52 user nova-compute[82617]:     <system>
Apr 17 15:29:52 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:29:52 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:29:52 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:29:52 user nova-compute[82617]:       <entry name="serial">66369a14-9c32-49ed-95b0-f02558081f99</entry>
Apr 17 15:29:52 user nova-compute[82617]:       <entry name="uuid">66369a14-9c32-49ed-95b0-f02558081f99</entry>
Apr 17 15:29:52 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:29:52 user nova-compute[82617]:     </system>
Apr 17 15:29:52 user nova-compute[82617]:   </sysinfo>
Apr 17 15:29:52 user nova-compute[82617]:   <os>
Apr 17 15:29:52 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:29:52 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:29:52 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:29:52 user nova-compute[82617]:   </os>
Apr 17 15:29:52 user nova-compute[82617]:   <features>
Apr 17 15:29:52 user nova-compute[82617]:     <acpi/>
Apr 17 15:29:52 user nova-compute[82617]:     <apic/>
Apr 17 15:29:52 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:29:52 user nova-compute[82617]:   </features>
Apr 17 15:29:52 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:29:52 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:29:52 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:29:52 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:29:52 user nova-compute[82617]:   </clock>
Apr 17 15:29:52 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:29:52 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:29:52 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:29:52 user nova-compute[82617]:   </cpu>
Apr 17 15:29:52 user nova-compute[82617]:   <devices>
Apr 17 15:29:52 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:29:52 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:29:52 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk"/>
Apr 17 15:29:52 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:29:52 user nova-compute[82617]:     </disk>
Apr 17 15:29:52 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:29:52 user nova-compute[82617]:       <mac address="fa:16:3e:66:a3:e8"/>
Apr 17 15:29:52 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:29:52 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:29:52 user nova-compute[82617]:       <target dev="tap4b5f4c19-2c"/>
Apr 17 15:29:52 user nova-compute[82617]:     </interface>
Apr 17 15:29:52 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:29:52 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/console.log" append="off"/>
Apr 17 15:29:52 user nova-compute[82617]:     </serial>
Apr 17 15:29:52 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:29:52 user nova-compute[82617]:     <video>
Apr 17 15:29:52 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:29:52 user nova-compute[82617]:     </video>
Apr 17 15:29:52 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:29:52 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:29:52 user nova-compute[82617]:     </rng>
Apr 17 15:29:52 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:29:52 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:29:52 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:29:52 user nova-compute[82617]:     </memballoon>
Apr 17 15:29:52 user nova-compute[82617]:   </devices>
Apr 17 15:29:52 user nova-compute[82617]: </domain>
Apr 17 15:29:52 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1105673637',display_name='tempest-ServersNegativeTestJSON-server-1105673637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1105673637',id=15,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2dd48f279404859bebcc19bcc272915',ramdisk_id='',reservation_id='r-l2o14muk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1985071109',owner_user_name='tempest-ServersNegativeTestJSON-1985071109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:29:50Z,user_data=None,user_id='b0075b26d6044a50981d29df0d863959',uuid=66369a14-9c32-49ed-95b0-f02558081f99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converting VIF {"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:e8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f4c19-2c4d-42a0-b8db-a2debaa63fec,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f4c19-2c') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG os_vif [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:e8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f4c19-2c4d-42a0-b8db-a2debaa63fec,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f4c19-2c') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b5f4c19-2c, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b5f4c19-2c, col_values=(('external_ids', {'iface-id': '4b5f4c19-2c4d-42a0-b8db-a2debaa63fec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:a3:e8', 'vm-uuid': '66369a14-9c32-49ed-95b0-f02558081f99'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:52 user nova-compute[82617]: INFO os_vif [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:e8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f4c19-2c4d-42a0-b8db-a2debaa63fec,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f4c19-2c')
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:29:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] No VIF found with MAC fa:16:3e:66:a3:e8, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:29:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-71478c17-1095-4616-a726-3514d7c56d00 req-410d8abe-05c5-49f3-b06f-751f25f1b95c service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated VIF entry in instance network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:29:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-71478c17-1095-4616-a726-3514d7c56d00 req-410d8abe-05c5-49f3-b06f-751f25f1b95c service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:29:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-71478c17-1095-4616-a726-3514d7c56d00 req-410d8abe-05c5-49f3-b06f-751f25f1b95c service nova] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:29:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-0f5edc85-ef78-4657-a6c6-c7e4d8a181e8 req-2c878124-3dee-47e0-b795-baba7b16fa33 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Updated VIF entry in instance network info cache for port 4b5f4c19-2c4d-42a0-b8db-a2debaa63fec. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:29:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-0f5edc85-ef78-4657-a6c6-c7e4d8a181e8 req-2c878124-3dee-47e0-b795-baba7b16fa33 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Updating instance_info_cache with network_info: [{"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:29:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0f5edc85-ef78-4657-a6c6-c7e4d8a181e8 req-2c878124-3dee-47e0-b795-baba7b16fa33 service nova] Releasing lock "refresh_cache-66369a14-9c32-49ed-95b0-f02558081f99" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-27bab3bd-f96d-4b87-bc50-3eaf94855994 req-8cf3127c-3dd8-4863-9e0e-9e7b2bd62b03 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received event network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27bab3bd-f96d-4b87-bc50-3eaf94855994 req-8cf3127c-3dd8-4863-9e0e-9e7b2bd62b03 service nova] Acquiring lock "66369a14-9c32-49ed-95b0-f02558081f99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27bab3bd-f96d-4b87-bc50-3eaf94855994 req-8cf3127c-3dd8-4863-9e0e-9e7b2bd62b03 service nova] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-27bab3bd-f96d-4b87-bc50-3eaf94855994 req-8cf3127c-3dd8-4863-9e0e-9e7b2bd62b03 service nova] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-27bab3bd-f96d-4b87-bc50-3eaf94855994 req-8cf3127c-3dd8-4863-9e0e-9e7b2bd62b03 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] No waiting events found dispatching network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:29:54 user nova-compute[82617]: WARNING nova.compute.manager [req-27bab3bd-f96d-4b87-bc50-3eaf94855994 req-8cf3127c-3dd8-4863-9e0e-9e7b2bd62b03 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received unexpected event network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec for instance with vm_state building and task_state spawning.
Apr 17 15:29:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-0dc13b2e-ffcd-4968-94a8-56f04eaa6f91 req-26c8e219-e5ef-47a8-b60a-17530891dec5 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received event network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0dc13b2e-ffcd-4968-94a8-56f04eaa6f91 req-26c8e219-e5ef-47a8-b60a-17530891dec5 service nova] Acquiring lock "66369a14-9c32-49ed-95b0-f02558081f99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0dc13b2e-ffcd-4968-94a8-56f04eaa6f91 req-26c8e219-e5ef-47a8-b60a-17530891dec5 service nova] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0dc13b2e-ffcd-4968-94a8-56f04eaa6f91 req-26c8e219-e5ef-47a8-b60a-17530891dec5 service nova] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-0dc13b2e-ffcd-4968-94a8-56f04eaa6f91 req-26c8e219-e5ef-47a8-b60a-17530891dec5 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] No waiting events found dispatching network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:29:56 user nova-compute[82617]: WARNING nova.compute.manager [req-0dc13b2e-ffcd-4968-94a8-56f04eaa6f91 req-26c8e219-e5ef-47a8-b60a-17530891dec5 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received unexpected event network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec for instance with vm_state building and task_state spawning.
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745396.5533779, 66369a14-9c32-49ed-95b0-f02558081f99 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:29:56 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] VM Resumed (Lifecycle Event)
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:29:56 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Instance spawned successfully.
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:29:56 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681745396.5572968, 66369a14-9c32-49ed-95b0-f02558081f99 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:29:56 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] VM Started (Lifecycle Event)
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:29:56 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:29:56 user nova-compute[82617]: INFO nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Took 6.51 seconds to spawn the instance on the hypervisor.
Apr 17 15:29:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:29:56 user nova-compute[82617]: INFO nova.compute.manager [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Took 7.46 seconds to build instance.
Apr 17 15:29:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-578905f8-2161-487b-adc2-7eab54c871ff tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "66369a14-9c32-49ed-95b0-f02558081f99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.563s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:29:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:29:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:30:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:30:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:30:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:30:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG nova.compute.manager [req-a7e3cddb-664e-4903-b6e9-4c14ff836a9f req-0f42d4c4-ad5d-4531-b896-5ac1faffa7e5 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a7e3cddb-664e-4903-b6e9-4c14ff836a9f req-0f42d4c4-ad5d-4531-b896-5ac1faffa7e5 service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a7e3cddb-664e-4903-b6e9-4c14ff836a9f req-0f42d4c4-ad5d-4531-b896-5ac1faffa7e5 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a7e3cddb-664e-4903-b6e9-4c14ff836a9f req-0f42d4c4-ad5d-4531-b896-5ac1faffa7e5 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG nova.compute.manager [req-a7e3cddb-664e-4903-b6e9-4c14ff836a9f req-0f42d4c4-ad5d-4531-b896-5ac1faffa7e5 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:30:21 user nova-compute[82617]: WARNING nova.compute.manager [req-a7e3cddb-664e-4903-b6e9-4c14ff836a9f req-0f42d4c4-ad5d-4531-b896-5ac1faffa7e5 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state rescued and task_state unrescuing.
Apr 17 15:30:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:22 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance destroyed successfully.
Apr 17 15:30:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:30:23 user nova-compute[82617]: WARNING nova.compute.manager [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state rescued and task_state unrescuing.
Apr 17 15:30:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:30:23 user nova-compute[82617]: WARNING nova.compute.manager [req-6631dd7a-9ab0-40a4-a231-02a73e62220f req-a295ed2e-05f9-4c3d-9738-7b315b2581b3 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state rescued and task_state unrescuing.
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Error launching a defined domain with XML: <domain type='kvm'>
Apr 17 15:30:24 user nova-compute[82617]:   <name>instance-00000003</name>
Apr 17 15:30:24 user nova-compute[82617]:   <uuid>fc3385ee-a569-4a45-812b-b9073d774535</uuid>
Apr 17 15:30:24 user nova-compute[82617]:   <metadata>
Apr 17 15:30:24 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:30:24 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:30:24 user nova-compute[82617]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-765067727</nova:name>
Apr 17 15:30:24 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:24:06</nova:creationTime>
Apr 17 15:30:24 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:30:24 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:30:24 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:30:24 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:30:24 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:30:24 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:30:24 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:30:24 user nova-compute[82617]:       <nova:owner>
Apr 17 15:30:24 user nova-compute[82617]:         <nova:user uuid="a972c04314724233bc8e33b64747fecf">tempest-ServerStableDeviceRescueTest-869290889-project-member</nova:user>
Apr 17 15:30:24 user nova-compute[82617]:         <nova:project uuid="6bdfb8642b9341f6ba289e920c33cf47">tempest-ServerStableDeviceRescueTest-869290889</nova:project>
Apr 17 15:30:24 user nova-compute[82617]:       </nova:owner>
Apr 17 15:30:24 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:30:24 user nova-compute[82617]:       <nova:ports>
Apr 17 15:30:24 user nova-compute[82617]:         <nova:port uuid="06c113c7-a663-47b8-a618-0a22d3e345a4">
Apr 17 15:30:24 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 15:30:24 user nova-compute[82617]:         </nova:port>
Apr 17 15:30:24 user nova-compute[82617]:       </nova:ports>
Apr 17 15:30:24 user nova-compute[82617]:     </nova:instance>
Apr 17 15:30:24 user nova-compute[82617]:   </metadata>
Apr 17 15:30:24 user nova-compute[82617]:   <memory unit='KiB'>131072</memory>
Apr 17 15:30:24 user nova-compute[82617]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 17 15:30:24 user nova-compute[82617]:   <vcpu placement='static'>1</vcpu>
Apr 17 15:30:24 user nova-compute[82617]:   <sysinfo type='smbios'>
Apr 17 15:30:24 user nova-compute[82617]:     <system>
Apr 17 15:30:24 user nova-compute[82617]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 17 15:30:24 user nova-compute[82617]:       <entry name='product'>OpenStack Nova</entry>
Apr 17 15:30:24 user nova-compute[82617]:       <entry name='version'>0.0.0</entry>
Apr 17 15:30:24 user nova-compute[82617]:       <entry name='serial'>fc3385ee-a569-4a45-812b-b9073d774535</entry>
Apr 17 15:30:24 user nova-compute[82617]:       <entry name='uuid'>fc3385ee-a569-4a45-812b-b9073d774535</entry>
Apr 17 15:30:24 user nova-compute[82617]:       <entry name='family'>Virtual Machine</entry>
Apr 17 15:30:24 user nova-compute[82617]:     </system>
Apr 17 15:30:24 user nova-compute[82617]:   </sysinfo>
Apr 17 15:30:24 user nova-compute[82617]:   <os>
Apr 17 15:30:24 user nova-compute[82617]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 17 15:30:24 user nova-compute[82617]:     <boot dev='hd'/>
Apr 17 15:30:24 user nova-compute[82617]:     <smbios mode='sysinfo'/>
Apr 17 15:30:24 user nova-compute[82617]:   </os>
Apr 17 15:30:24 user nova-compute[82617]:   <features>
Apr 17 15:30:24 user nova-compute[82617]:     <acpi/>
Apr 17 15:30:24 user nova-compute[82617]:     <apic/>
Apr 17 15:30:24 user nova-compute[82617]:     <vmcoreinfo state='on'/>
Apr 17 15:30:24 user nova-compute[82617]:   </features>
Apr 17 15:30:24 user nova-compute[82617]:   <cpu mode='custom' match='exact' check='partial'>
Apr 17 15:30:24 user nova-compute[82617]:     <model fallback='allow'>Nehalem</model>
Apr 17 15:30:24 user nova-compute[82617]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 17 15:30:24 user nova-compute[82617]:   </cpu>
Apr 17 15:30:24 user nova-compute[82617]:   <clock offset='utc'>
Apr 17 15:30:24 user nova-compute[82617]:     <timer name='pit' tickpolicy='delay'/>
Apr 17 15:30:24 user nova-compute[82617]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 17 15:30:24 user nova-compute[82617]:     <timer name='hpet' present='no'/>
Apr 17 15:30:24 user nova-compute[82617]:   </clock>
Apr 17 15:30:24 user nova-compute[82617]:   <on_poweroff>destroy</on_poweroff>
Apr 17 15:30:24 user nova-compute[82617]:   <on_reboot>restart</on_reboot>
Apr 17 15:30:24 user nova-compute[82617]:   <on_crash>destroy</on_crash>
Apr 17 15:30:24 user nova-compute[82617]:   <devices>
Apr 17 15:30:24 user nova-compute[82617]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 17 15:30:24 user nova-compute[82617]:     <disk type='file' device='disk'>
Apr 17 15:30:24 user nova-compute[82617]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 17 15:30:24 user nova-compute[82617]:       <source file='/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk'/>
Apr 17 15:30:24 user nova-compute[82617]:       <target dev='vda' bus='virtio'/>
Apr 17 15:30:24 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 17 15:30:24 user nova-compute[82617]:     </disk>
Apr 17 15:30:24 user nova-compute[82617]:     <disk type='block' device='disk'>
Apr 17 15:30:24 user nova-compute[82617]:       <driver name='qemu' type='raw' cache='none' io='native'/>
Apr 17 15:30:24 user nova-compute[82617]:       <source dev='/dev/sdb'/>
Apr 17 15:30:24 user nova-compute[82617]:       <target dev='vdb' bus='virtio'/>
Apr 17 15:30:24 user nova-compute[82617]:       <serial>32819ec1-2236-465f-a1c7-ee31aa4a0911</serial>
Apr 17 15:30:24 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 17 15:30:24 user nova-compute[82617]:     </disk>
Apr 17 15:30:24 user nova-compute[82617]:     <controller type='usb' index='0' model='none'/>
Apr 17 15:30:24 user nova-compute[82617]:     <controller type='pci' index='0' model='pci-root'/>
Apr 17 15:30:24 user nova-compute[82617]:     <interface type='ethernet'>
Apr 17 15:30:24 user nova-compute[82617]:       <mac address='fa:16:3e:b8:22:83'/>
Apr 17 15:30:24 user nova-compute[82617]:       <target dev='tap06c113c7-a6'/>
Apr 17 15:30:24 user nova-compute[82617]:       <model type='virtio'/>
Apr 17 15:30:24 user nova-compute[82617]:       <mtu size='1442'/>
Apr 17 15:30:24 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 17 15:30:24 user nova-compute[82617]:     </interface>
Apr 17 15:30:24 user nova-compute[82617]:     <serial type='pty'>
Apr 17 15:30:24 user nova-compute[82617]:       <log file='/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/console.log' append='off'/>
Apr 17 15:30:24 user nova-compute[82617]:       <target type='isa-serial' port='0'>
Apr 17 15:30:24 user nova-compute[82617]:         <model name='isa-serial'/>
Apr 17 15:30:24 user nova-compute[82617]:       </target>
Apr 17 15:30:24 user nova-compute[82617]:     </serial>
Apr 17 15:30:24 user nova-compute[82617]:     <console type='pty'>
Apr 17 15:30:24 user nova-compute[82617]:       <log file='/opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/console.log' append='off'/>
Apr 17 15:30:24 user nova-compute[82617]:       <target type='serial' port='0'/>
Apr 17 15:30:24 user nova-compute[82617]:     </console>
Apr 17 15:30:24 user nova-compute[82617]:     <input type='mouse' bus='ps2'/>
Apr 17 15:30:24 user nova-compute[82617]:     <input type='keyboard' bus='ps2'/>
Apr 17 15:30:24 user nova-compute[82617]:     <graphics type='vnc' port='-1' autoport='yes' listen='0.0.0.0'>
Apr 17 15:30:24 user nova-compute[82617]:       <listen type='address' address='0.0.0.0'/>
Apr 17 15:30:24 user nova-compute[82617]:     </graphics>
Apr 17 15:30:24 user nova-compute[82617]:     <audio id='1' type='none'/>
Apr 17 15:30:24 user nova-compute[82617]:     <video>
Apr 17 15:30:24 user nova-compute[82617]:       <model type='virtio' heads='1' primary='yes'/>
Apr 17 15:30:24 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 17 15:30:24 user nova-compute[82617]:     </video>
Apr 17 15:30:24 user nova-compute[82617]:     <memballoon model='virtio'>
Apr 17 15:30:24 user nova-compute[82617]:       <stats period='10'/>
Apr 17 15:30:24 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 17 15:30:24 user nova-compute[82617]:     </memballoon>
Apr 17 15:30:24 user nova-compute[82617]:     <rng model='virtio'>
Apr 17 15:30:24 user nova-compute[82617]:       <backend model='random'>/dev/urandom</backend>
Apr 17 15:30:24 user nova-compute[82617]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 17 15:30:24 user nova-compute[82617]:     </rng>
Apr 17 15:30:24 user nova-compute[82617]:   </devices>
Apr 17 15:30:24 user nova-compute[82617]: </domain>
Apr 17 15:30:24 user nova-compute[82617]: : libvirt.libvirtError: unable to open /dev/sdb: No such device or address
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest Traceback (most recent call last):
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 165, in launch
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest     return self._domain.createWithFlags(flags)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest     result = proxy_call(self._autowrap, f, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest     rv = execute(f, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest     six.reraise(c, e, tb)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest     raise value
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest     rv = meth(*args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest   File "/usr/lib/python3/dist-packages/libvirt.py", line 1385, in createWithFlags
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest     raise libvirtError('virDomainCreateWithFlags() failed')
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest libvirt.libvirtError: unable to open /dev/sdb: No such device or address
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.virt.libvirt.guest 
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Setting instance vm_state to ERROR: libvirt.libvirtError: unable to open /dev/sdb: No such device or address
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535] Traceback (most recent call last):
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/opt/stack/nova/nova/compute/manager.py", line 10716, in _error_out_instance_on_exception
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     yield
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/opt/stack/nova/nova/compute/manager.py", line 4633, in unrescue_instance
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     self.driver.unrescue(orig_context, instance)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4327, in unrescue
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     self._create_guest(context, xml, instance)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7666, in _create_guest
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     guest.launch(pause=pause)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 167, in launch
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     with excutils.save_and_reraise_exception():
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     self.force_reraise()
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     raise self.value
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 165, in launch
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     return self._domain.createWithFlags(flags)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     rv = execute(f, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     six.reraise(c, e, tb)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     raise value
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     rv = meth(*args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]   File "/usr/lib/python3/dist-packages/libvirt.py", line 1385, in createWithFlags
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535]     raise libvirtError('virDomainCreateWithFlags() failed')
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535] libvirt.libvirtError: unable to open /dev/sdb: No such device or address
Apr 17 15:30:24 user nova-compute[82617]: ERROR nova.compute.manager [instance: fc3385ee-a569-4a45-812b-b9073d774535] 
Apr 17 15:30:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:30:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:24 user nova-compute[82617]: INFO nova.compute.manager [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Successfully reverted task state from unrescuing on failure for instance.
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server [None req-45dce2f1-27c1-4f7a-a9b3-418364b89d25 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Exception during message handling: libvirt.libvirtError: unable to open /dev/sdb: No such device or address
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4633, in unrescue_instance
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.driver.unrescue(orig_context, instance)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4327, in unrescue
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._create_guest(context, xml, instance)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7666, in _create_guest
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     guest.launch(pause=pause)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 167, in launch
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 165, in launch
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._domain.createWithFlags(flags)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise value
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 1385, in createWithFlags
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainCreateWithFlags() failed')
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: unable to open /dev/sdb: No such device or address
Apr 17 15:30:24 user nova-compute[82617]: ERROR oslo_messaging.rpc.server 
Apr 17 15:30:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:30:25 user nova-compute[82617]: WARNING nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state error and task_state None.
Apr 17 15:30:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:30:25 user nova-compute[82617]: WARNING nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-unplugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state error and task_state None.
Apr 17 15:30:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] No waiting events found dispatching network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:30:25 user nova-compute[82617]: WARNING nova.compute.manager [req-9c3770bd-340a-4263-895e-67fc6b0d879d req-a4960c2a-3610-4b14-b0c7-ac2ea5f4d25e service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received unexpected event network-vif-plugged-06c113c7-a663-47b8-a618-0a22d3e345a4 for instance with vm_state error and task_state None.
Apr 17 15:30:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:30:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:30:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7891MB free_disk=26.393959045410156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05ccc225-01da-4975-97de-f1c0fbf20a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 66369a14-9c32-49ed-95b0-f02558081f99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:30:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:30:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Updating instance_info_cache with network_info: [{"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-c0e53ff8-38c3-4353-a225-22ceae908f50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:30:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:37 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745422.045041, fc3385ee-a569-4a45-812b-b9073d774535 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:30:37 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] VM Stopped (Lifecycle Event)
Apr 17 15:30:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-649128bc-2955-4f22-8a4a-938dfaa7e2f8 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:30:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-649128bc-2955-4f22-8a4a-938dfaa7e2f8 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: error, current task_state: None, current DB power_state: 1, VM power_state: 4 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:30:37 user nova-compute[82617]: INFO nova.compute.manager [None req-649128bc-2955-4f22-8a4a-938dfaa7e2f8 None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (4). Updating power_state in the DB to match the hypervisor.
Apr 17 15:30:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:30:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:30:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:30:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:30:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:30:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:38 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:30:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:30:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:30:42 user nova-compute[82617]: INFO nova.compute.manager [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Detaching volume 13bf568b-585c-4556-ab78-e9930ad50214
Apr 17 15:30:42 user nova-compute[82617]: INFO nova.virt.block_device [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Attempting to driver detach volume 13bf568b-585c-4556-ab78-e9930ad50214 from mountpoint /dev/vdc
Apr 17 15:30:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Attempting to detach device vdc from instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc from the persistent domain config. {{(pid=82617) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:30:42 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:30:42 user nova-compute[82617]:   <source dev="/dev/sdd"/>
Apr 17 15:30:42 user nova-compute[82617]:   <target dev="vdc" bus="virtio"/>
Apr 17 15:30:42 user nova-compute[82617]:   <serial>13bf568b-585c-4556-ab78-e9930ad50214</serial>
Apr 17 15:30:42 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 15:30:42 user nova-compute[82617]: </disk>
Apr 17 15:30:42 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:30:42 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Successfully detached device vdc from instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc from the persistent domain config.
Apr 17 15:30:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc from the live domain config. {{(pid=82617) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:30:42 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:30:42 user nova-compute[82617]:   <source dev="/dev/sdd"/>
Apr 17 15:30:42 user nova-compute[82617]:   <target dev="vdc" bus="virtio"/>
Apr 17 15:30:42 user nova-compute[82617]:   <serial>13bf568b-585c-4556-ab78-e9930ad50214</serial>
Apr 17 15:30:42 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 15:30:42 user nova-compute[82617]: </disk>
Apr 17 15:30:42 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Received event <DeviceRemovedEvent: 1681745442.6642957, 6aab9803-ab51-47c6-a2a2-739a7a18f5dc => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82617) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 15:30:42 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Successfully detached device vdc from instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc from the live domain config.
Apr 17 15:30:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajgFQvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:30:42 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9d713e-1219-4745-b154-19a06781c416]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:30:42 user nova-compute[82617]: No targets found.
Apr 17 15:30:42 user nova-compute[82617]: iSNS:
Apr 17 15:30:42 user nova-compute[82617]: No targets found.
Apr 17 15:30:42 user nova-compute[82617]: STATIC:
Apr 17 15:30:42 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9
Apr 17 15:30:42 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:30:42 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:30:42 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214
Apr 17 15:30:42 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:30:42 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:30:42 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911
Apr 17 15:30:42 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:30:42 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:30:42 user nova-compute[82617]: FIRMWARE:
Apr 17 15:30:42 user nova-compute[82617]: No targets found.
Apr 17 15:30:42 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:30:42 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:30:42 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec1ec00-7b9f-4388-bce9-faf067572e00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b187df-48cf-4c84-b78c-54a9ecc68c15]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:30:42 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:30:42 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 15:30:42 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:30:42 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:30:42 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 15:30:42 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64e7b4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214'): ({'sdd'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Removing single pathed devices sdd {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dedd8d-a102-43d2-8b5d-4065fecd9a00]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[102c671e-ebb8-4d12-81e5-6a8d4c4ac7c6]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flushing IO for device /dev/sdd {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 1 in 0.012s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdd' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 20 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 15:30:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:30:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 1 in 20.027s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdd' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 15:31:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:02 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 40 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 15:31:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.volume.cinder [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Update attachment failed for attachment 9b0bf9c4-9b18-4c4d-9466-e0dd3f87e23d. Error: Unable to update the attachment. (HTTP 500) (Request-ID: req-43c9eb22-6970-4755-97a1-9763d442bfdd) Code: 500: cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-43c9eb22-6970-4755-97a1-9763d442bfdd)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-43c9eb22-6970-4755-97a1-9763d442bfdd)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Traceback (most recent call last):
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/compute/manager.py", line 2175, in _prep_block_device
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     driver_block_device.attach_block_devices(
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     _log_and_attach(device)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     bdm.attach(*attach_args, **attach_kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     ret_val = method(obj, context, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     self._do_attach(context, instance, volume, volume_api,
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     self._volume_attach(context, volume, connector, instance,
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     connection_info = volume_api.attachment_update(
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     res = method(self, ctx, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/volume/cinder.py", line 449, in wrapper
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     res = method(self, ctx, attachment_id, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/volume/cinder.py", line 880, in attachment_update
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     with excutils.save_and_reraise_exception():
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     self.force_reraise()
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     raise self.value
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/opt/stack/nova/nova/volume/cinder.py", line 874, in attachment_update
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     context, '3.44', skip_version_check=True).attachments.update(
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     return method.func(obj, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     resp = self._update('/attachments/%s' % id, body)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     resp, body = self.api.client.put(url, body=body, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     return self._cs_request(url, 'PUT', **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     return self.request(url, method, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7]     raise exceptions.from_response(resp, body)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-43c9eb22-6970-4755-97a1-9763d442bfdd)
Apr 17 15:31:16 user nova-compute[82617]: ERROR nova.compute.manager [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] 
Apr 17 15:31:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Lock "edb2d74c-f1e0-4954-9ba9-812fc12562a7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 120.520s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:16 user nova-compute[82617]: INFO nova.compute.manager [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] [instance: edb2d74c-f1e0-4954-9ba9-812fc12562a7] Successfully reverted task state from spawning on failure for instance.
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server [None req-cddb5331-13a7-4304-8a88-324e7cbf6185 tempest-TestShelveInstance-1683612675 tempest-TestShelveInstance-1683612675-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update the attachment. (HTTP 500) (Request-ID: req-43c9eb22-6970-4755-97a1-9763d442bfdd)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2175, in _prep_block_device
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 449, in wrapper
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 880, in attachment_update
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 874, in attachment_update
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-43c9eb22-6970-4755-97a1-9763d442bfdd)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server 
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server 
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6957, in unshelve_instance
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6954, in do_unshelve_instance
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6986, in _unshelve_instance
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2194, in _prep_block_device
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update the attachment. (HTTP 500) (Request-ID: req-43c9eb22-6970-4755-97a1-9763d442bfdd)
Apr 17 15:31:16 user nova-compute[82617]: ERROR oslo_messaging.rpc.server 
Apr 17 15:31:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:31:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:31:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7954MB free_disk=26.389171600341797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:31:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05ccc225-01da-4975-97de-f1c0fbf20a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 66369a14-9c32-49ed-95b0-f02558081f99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:31:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updating instance_info_cache with network_info: [{"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:31:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "66369a14-9c32-49ed-95b0-f02558081f99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "66369a14-9c32-49ed-95b0-f02558081f99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "66369a14-9c32-49ed-95b0-f02558081f99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:39 user nova-compute[82617]: INFO nova.compute.manager [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Terminating instance
Apr 17 15:31:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG nova.compute.manager [req-dbfb0d4d-dd02-4173-b0c1-311a4be1a185 req-63c7fd41-d786-4b66-b730-23629f433a5d service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received event network-vif-unplugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-dbfb0d4d-dd02-4173-b0c1-311a4be1a185 req-63c7fd41-d786-4b66-b730-23629f433a5d service nova] Acquiring lock "66369a14-9c32-49ed-95b0-f02558081f99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-dbfb0d4d-dd02-4173-b0c1-311a4be1a185 req-63c7fd41-d786-4b66-b730-23629f433a5d service nova] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-dbfb0d4d-dd02-4173-b0c1-311a4be1a185 req-63c7fd41-d786-4b66-b730-23629f433a5d service nova] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG nova.compute.manager [req-dbfb0d4d-dd02-4173-b0c1-311a4be1a185 req-63c7fd41-d786-4b66-b730-23629f433a5d service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] No waiting events found dispatching network-vif-unplugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG nova.compute.manager [req-dbfb0d4d-dd02-4173-b0c1-311a4be1a185 req-63c7fd41-d786-4b66-b730-23629f433a5d service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received event network-vif-unplugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Instance destroyed successfully.
Apr 17 15:31:39 user nova-compute[82617]: DEBUG nova.objects.instance [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lazy-loading 'resources' on Instance uuid 66369a14-9c32-49ed-95b0-f02558081f99 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1105673637',display_name='tempest-ServersNegativeTestJSON-server-1105673637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1105673637',id=15,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2dd48f279404859bebcc19bcc272915',ramdisk_id='',reservation_id='r-l2o14muk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1985071109',owner_user_name='tempest-ServersNegativeTestJSON-1985071109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:29:57Z,user_data=None,user_id='b0075b26d6044a50981d29df0d863959',uuid=66369a14-9c32-49ed-95b0-f02558081f99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converting VIF {"id": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "address": "fa:16:3e:66:a3:e8", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5f4c19-2c", "ovs_interfaceid": "4b5f4c19-2c4d-42a0-b8db-a2debaa63fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:e8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f4c19-2c4d-42a0-b8db-a2debaa63fec,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f4c19-2c') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG os_vif [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:e8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f4c19-2c4d-42a0-b8db-a2debaa63fec,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f4c19-2c') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b5f4c19-2c, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:40 user nova-compute[82617]: INFO os_vif [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:e8,bridge_name='br-int',has_traffic_filtering=True,id=4b5f4c19-2c4d-42a0-b8db-a2debaa63fec,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5f4c19-2c')
Apr 17 15:31:40 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Deleting instance files /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99_del
Apr 17 15:31:40 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Deletion of /opt/stack/data/nova/instances/66369a14-9c32-49ed-95b0-f02558081f99_del complete
Apr 17 15:31:40 user nova-compute[82617]: INFO nova.compute.manager [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 17 15:31:40 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:31:40 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Took 0.50 seconds to deallocate network for instance.
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.compute.manager [req-78df2e63-0632-4ae0-89a1-f84cf27b01eb req-d7290f3e-0384-411c-995d-e1b5f3cd19a3 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received event network-vif-deleted-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:31:40 user nova-compute[82617]: INFO nova.compute.manager [req-78df2e63-0632-4ae0-89a1-f84cf27b01eb req-d7290f3e-0384-411c-995d-e1b5f3cd19a3 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Neutron deleted interface 4b5f4c19-2c4d-42a0-b8db-a2debaa63fec; detaching it from the instance and deleting it from the info cache
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.network.neutron [req-78df2e63-0632-4ae0-89a1-f84cf27b01eb req-d7290f3e-0384-411c-995d-e1b5f3cd19a3 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.compute.manager [req-78df2e63-0632-4ae0-89a1-f84cf27b01eb req-d7290f3e-0384-411c-995d-e1b5f3cd19a3 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Detach interface failed, port_id=4b5f4c19-2c4d-42a0-b8db-a2debaa63fec, reason: Instance 66369a14-9c32-49ed-95b0-f02558081f99 could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:31:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:40 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Deleted allocations for instance 66369a14-9c32-49ed-95b0-f02558081f99
Apr 17 15:31:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a51bb346-fa84-4515-b7cc-3382b6d44b15 tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "66369a14-9c32-49ed-95b0-f02558081f99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.677s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:41 user nova-compute[82617]: DEBUG nova.compute.manager [req-05940407-b30c-4b68-9bdf-47a75fd09bea req-0427f1ce-defe-4e2e-8db6-40365dbc6bb5 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received event network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:31:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-05940407-b30c-4b68-9bdf-47a75fd09bea req-0427f1ce-defe-4e2e-8db6-40365dbc6bb5 service nova] Acquiring lock "66369a14-9c32-49ed-95b0-f02558081f99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:31:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-05940407-b30c-4b68-9bdf-47a75fd09bea req-0427f1ce-defe-4e2e-8db6-40365dbc6bb5 service nova] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-05940407-b30c-4b68-9bdf-47a75fd09bea req-0427f1ce-defe-4e2e-8db6-40365dbc6bb5 service nova] Lock "66369a14-9c32-49ed-95b0-f02558081f99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:41 user nova-compute[82617]: DEBUG nova.compute.manager [req-05940407-b30c-4b68-9bdf-47a75fd09bea req-0427f1ce-defe-4e2e-8db6-40365dbc6bb5 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] No waiting events found dispatching network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:31:41 user nova-compute[82617]: WARNING nova.compute.manager [req-05940407-b30c-4b68-9bdf-47a75fd09bea req-0427f1ce-defe-4e2e-8db6-40365dbc6bb5 service nova] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Received unexpected event network-vif-plugged-4b5f4c19-2c4d-42a0-b8db-a2debaa63fec for instance with vm_state deleted and task_state None.
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.volume.cinder [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Update attachment failed for attachment f92396df-2a76-4bb0-9a46-97760ba2708a. Error: Unable to update the attachment. (HTTP 500) (Request-ID: req-073af777-dfca-4d61-85d6-9ed616a692d0) Code: 500: cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-073af777-dfca-4d61-85d6-9ed616a692d0)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Failed to attach a9c177a1-61f0-4201-bb8d-7f18c9af396c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-073af777-dfca-4d61-85d6-9ed616a692d0)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Traceback (most recent call last):
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/compute/manager.py", line 7441, in _attach_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     bdm.attach(context, instance, self.volume_api, self.driver,
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     ret_val = method(obj, context, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     self._do_attach(context, instance, volume, volume_api,
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     self._volume_attach(context, volume, connector, instance,
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     connection_info = volume_api.attachment_update(
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     res = method(self, ctx, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/volume/cinder.py", line 449, in wrapper
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     res = method(self, ctx, attachment_id, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/volume/cinder.py", line 880, in attachment_update
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     with excutils.save_and_reraise_exception():
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     self.force_reraise()
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     raise self.value
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/opt/stack/nova/nova/volume/cinder.py", line 874, in attachment_update
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     context, '3.44', skip_version_check=True).attachments.update(
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     return method.func(obj, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     resp = self._update('/attachments/%s' % id, body)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     resp, body = self.api.client.put(url, body=body, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     return self._cs_request(url, 'PUT', **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     return self.request(url, method, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50]     raise exceptions.from_response(resp, body)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-073af777-dfca-4d61-85d6-9ed616a692d0)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] 
Apr 17 15:31:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 120.440s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 118.822s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server [None req-38bdff97-cca4-4bb8-8df0-3261c844629a tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-073af777-dfca-4d61-85d6-9ed616a692d0)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7427, in attach_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7424, in do_attach_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7422, in do_attach_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7444, in _attach_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7441, in _attach_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 449, in wrapper
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 880, in attachment_update
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 874, in attachment_update
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-073af777-dfca-4d61-85d6-9ed616a692d0)
Apr 17 15:31:42 user nova-compute[82617]: ERROR oslo_messaging.rpc.server 
Apr 17 15:31:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 1 in 40.052s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdd' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:31:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[09119d50-f9ed-4785-940f-2eff96b14240]: Unexpected error while running command.
Apr 17 15:31:42 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdd
Apr 17 15:31:42 user nova-compute[82617]: Exit code: 1
Apr 17 15:31:42 user nova-compute[82617]: Stdout: ''
Apr 17 15:31:42 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n' {{(pid=92892) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 17 15:31:42 user nova-compute[82617]: Traceback (most recent call last):
Apr 17 15:31:42 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 17 15:31:42 user nova-compute[82617]:     ret = func(*f_args, **f_kwargs)
Apr 17 15:31:42 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 17 15:31:42 user nova-compute[82617]:     return func(*args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 17 15:31:42 user nova-compute[82617]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 17 15:31:42 user nova-compute[82617]:     return putils.execute(on_execute=on_execute,
Apr 17 15:31:42 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 17 15:31:42 user nova-compute[82617]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 17 15:31:42 user nova-compute[82617]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:31:42 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdd
Apr 17 15:31:42 user nova-compute[82617]: Exit code: 1
Apr 17 15:31:42 user nova-compute[82617]: Stdout: ''
Apr 17 15:31:42 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n'
Apr 17 15:31:42 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[09119d50-f9ed-4785-940f-2eff96b14240]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('', 'blockdev: cannot open /dev/sdd: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdd', None)) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:31:42 user nova-compute[82617]: WARNING os_brick.initiator.linuxscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Failed to flush IO buffers prior to removing device: 1: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:31:42 user nova-compute[82617]: WARNING os_brick.exception [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flushing /dev/sdd failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:31:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.224s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:31:42 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] <== disconnect_volume: exception (60226ms) ProcessExecutionError('', 'blockdev: cannot open /dev/sdd: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdd', None) {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:188}}
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Failed to detach volume 13bf568b-585c-4556-ab78-e9930ad50214 from /dev/vdc: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:31:42 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdd
Apr 17 15:31:42 user nova-compute[82617]: Exit code: 1
Apr 17 15:31:42 user nova-compute[82617]: Stdout: ''
Apr 17 15:31:42 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n'
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Traceback (most recent call last):
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 379, in driver_detach
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     virt_driver.detach_volume(context, connection_info, instance, mp,
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 2723, in detach_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     self._disconnect_volume(context, connection_info, instance,
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1989, in _disconnect_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     vol_driver.disconnect_volume(connection_info, instance)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/opt/stack/nova/nova/virt/libvirt/volume/iscsi.py", line 74, in disconnect_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     self.connector.disconnect_volume(connection_info['data'], None)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/utils.py", line 185, in trace_logging_wrapper
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     result = f(*args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py", line 78, in inner
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     return f(*args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/utils.py", line 387, in change_encrypted
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     res = func(**call_args)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 880, in disconnect_volume
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     return self._cleanup_connection(connection_properties, force=force,
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 934, in _cleanup_connection
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     multipath_name = self._linuxscsi.remove_connection(
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 333, in remove_connection
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     self.remove_scsi_device(dev_path, force, exc, flush)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 81, in remove_scsi_device
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     self.flush_device_io(device)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 370, in flush_device_io
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     self._execute('blockdev', '--flushbufs', device,
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     result = self.__execute(*args, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     return execute_root(*cmd, **kwargs)
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     return self.channel.remote_call(name, args, kwargs,
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc]     raise exc_type(*result[2])
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Command: blockdev --flushbufs /dev/sdd
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Exit code: 1
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Stdout: ''
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n'
Apr 17 15:31:42 user nova-compute[82617]: ERROR nova.virt.block_device [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] 
Apr 17 15:31:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 60.874s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server [None req-bf3de8e1-cfb4-4aca-8202-ff34392ef826 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Exception during message handling: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:31:43 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdd
Apr 17 15:31:43 user nova-compute[82617]: Exit code: 1
Apr 17 15:31:43 user nova-compute[82617]: Stdout: ''
Apr 17 15:31:43 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n'
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7588, in detach_volume
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     do_detach_volume(context, volume_id, instance, attachment_id)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7585, in do_detach_volume
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._detach_volume(context, bdm, instance,
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7536, in _detach_volume
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     driver_bdm.detach(context, instance, self.volume_api, self.driver,
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 538, in detach
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._do_detach(context, instance, volume_api, virt_driver,
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 459, in _do_detach
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.driver_detach(context, instance, volume_api, virt_driver)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 393, in driver_detach
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 379, in driver_detach
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     virt_driver.detach_volume(context, connection_info, instance, mp,
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 2723, in detach_volume
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._disconnect_volume(context, connection_info, instance,
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1989, in _disconnect_volume
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     vol_driver.disconnect_volume(connection_info, instance)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/volume/iscsi.py", line 74, in disconnect_volume
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.connector.disconnect_volume(connection_info['data'], None)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/utils.py", line 185, in trace_logging_wrapper
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py", line 78, in inner
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/utils.py", line 387, in change_encrypted
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = func(**call_args)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 880, in disconnect_volume
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._cleanup_connection(connection_properties, force=force,
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 934, in _cleanup_connection
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     multipath_name = self._linuxscsi.remove_connection(
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 333, in remove_connection
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.remove_scsi_device(dev_path, force, exc, flush)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 81, in remove_scsi_device
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.flush_device_io(device)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 370, in flush_device_io
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._execute('blockdev', '--flushbufs', device,
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = self.__execute(*args, **kwargs)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return execute_root(*cmd, **kwargs)
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self.channel.remote_call(name, args, kwargs,
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise exc_type(*result[2])
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Command: blockdev --flushbufs /dev/sdd
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Exit code: 1
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Stdout: ''
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n'
Apr 17 15:31:43 user nova-compute[82617]: ERROR oslo_messaging.rpc.server 
Apr 17 15:31:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:31:46 user nova-compute[82617]: INFO nova.compute.manager [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Detaching volume 1072d05f-2ebb-4398-902c-902df25464e9
Apr 17 15:31:46 user nova-compute[82617]: INFO nova.virt.block_device [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Attempting to driver detach volume 1072d05f-2ebb-4398-902c-902df25464e9 from mountpoint /dev/vdb
Apr 17 15:31:46 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Attempting to detach device vdb from instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 from the persistent domain config. {{(pid=82617) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:31:46 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:31:46 user nova-compute[82617]:   <source dev="/dev/sdc"/>
Apr 17 15:31:46 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:31:46 user nova-compute[82617]:   <serial>1072d05f-2ebb-4398-902c-902df25464e9</serial>
Apr 17 15:31:46 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 15:31:46 user nova-compute[82617]: </disk>
Apr 17 15:31:46 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:31:46 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Successfully detached device vdb from instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 from the persistent domain config.
Apr 17 15:31:46 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 from the live domain config. {{(pid=82617) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] detach device xml: <disk type="block" device="disk">
Apr 17 15:31:46 user nova-compute[82617]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 17 15:31:46 user nova-compute[82617]:   <source dev="/dev/sdc"/>
Apr 17 15:31:46 user nova-compute[82617]:   <target dev="vdb" bus="virtio"/>
Apr 17 15:31:46 user nova-compute[82617]:   <serial>1072d05f-2ebb-4398-902c-902df25464e9</serial>
Apr 17 15:31:46 user nova-compute[82617]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 17 15:31:46 user nova-compute[82617]: </disk>
Apr 17 15:31:46 user nova-compute[82617]:  {{(pid=82617) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Received event <DeviceRemovedEvent: 1681745506.9352012, d109f8c3-aed3-45af-ba8d-30b9006ef4e4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82617) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 17 15:31:46 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Successfully detached device vdb from instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 from the live domain config.
Apr 17 15:31:46 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:31:46 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:31:46 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04bebce-b2b0-4545-8380-b467ae932331]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:31:46 user nova-compute[82617]: No targets found.
Apr 17 15:31:46 user nova-compute[82617]: iSNS:
Apr 17 15:31:46 user nova-compute[82617]: No targets found.
Apr 17 15:31:46 user nova-compute[82617]: STATIC:
Apr 17 15:31:46 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9
Apr 17 15:31:46 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:31:46 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:31:46 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214
Apr 17 15:31:46 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:31:46 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:31:46 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911
Apr 17 15:31:46 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:31:46 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:31:46 user nova-compute[82617]: FIRMWARE:
Apr 17 15:31:46 user nova-compute[82617]: No targets found.
Apr 17 15:31:46 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:31:46 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:31:46 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8e39b7-0e65-4fd5-8548-110020aef6d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:31:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[448b0611-d229-4bb0-a486-390e481ddb5d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:31:47 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:31:47 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 15:31:47 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:31:47 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:31:47 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 15:31:47 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648087010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9'): ({'sdc'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Removing single pathed devices sdc {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e64858-eddd-4c80-820b-1e3b028067c4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f263d-4cda-4d9a-8934-e514550aa791]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flushing IO for device /dev/sdc {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 1 in 0.012s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdc' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:31:47 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 20 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 15:31:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:31:54 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745499.9462633, 66369a14-9c32-49ed-95b0-f02558081f99 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:31:54 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] VM Stopped (Lifecycle Event)
Apr 17 15:31:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d3aa9b5f-1870-456a-af49-fa7232253e66 None None] [instance: 66369a14-9c32-49ed-95b0-f02558081f99] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:31:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:31:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:31:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:31:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:31:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:31:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 1 in 20.023s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdc' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 15:32:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:07 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 40 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 15:32:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:32:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:32:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:32:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:32:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:32:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=26.38907241821289GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05ccc225-01da-4975-97de-f1c0fbf20a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:32:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:32:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:32:34 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:32:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:32:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:32:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:32:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updating instance_info_cache with network_info: [{"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:32:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:32:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:32:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:32:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:32:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:32:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:32:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 1 in 40.037s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:32:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdc' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:32:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[4fc1389d-ac1e-4ae5-85aa-49df896b88b8]: Unexpected error while running command.
Apr 17 15:32:47 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdc
Apr 17 15:32:47 user nova-compute[82617]: Exit code: 1
Apr 17 15:32:47 user nova-compute[82617]: Stdout: ''
Apr 17 15:32:47 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n' {{(pid=92892) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 17 15:32:47 user nova-compute[82617]: Traceback (most recent call last):
Apr 17 15:32:47 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 17 15:32:47 user nova-compute[82617]:     ret = func(*f_args, **f_kwargs)
Apr 17 15:32:47 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 17 15:32:47 user nova-compute[82617]:     return func(*args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 17 15:32:47 user nova-compute[82617]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 17 15:32:47 user nova-compute[82617]:     return putils.execute(on_execute=on_execute,
Apr 17 15:32:47 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 17 15:32:47 user nova-compute[82617]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 17 15:32:47 user nova-compute[82617]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:32:47 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdc
Apr 17 15:32:47 user nova-compute[82617]: Exit code: 1
Apr 17 15:32:47 user nova-compute[82617]: Stdout: ''
Apr 17 15:32:47 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n'
Apr 17 15:32:47 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc1389d-ac1e-4ae5-85aa-49df896b88b8]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('', 'blockdev: cannot open /dev/sdc: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdc', None)) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:32:47 user nova-compute[82617]: WARNING os_brick.initiator.linuxscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Failed to flush IO buffers prior to removing device: 1: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:32:47 user nova-compute[82617]: WARNING os_brick.exception [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flushing /dev/sdc failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:32:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.194s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:32:47 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] <== disconnect_volume: exception (60195ms) ProcessExecutionError('', 'blockdev: cannot open /dev/sdc: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdc', None) {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:188}}
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Failed to detach volume 1072d05f-2ebb-4398-902c-902df25464e9 from /dev/vdb: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:32:47 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdc
Apr 17 15:32:47 user nova-compute[82617]: Exit code: 1
Apr 17 15:32:47 user nova-compute[82617]: Stdout: ''
Apr 17 15:32:47 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n'
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Traceback (most recent call last):
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/opt/stack/nova/nova/virt/block_device.py", line 379, in driver_detach
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     virt_driver.detach_volume(context, connection_info, instance, mp,
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 2723, in detach_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     self._disconnect_volume(context, connection_info, instance,
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1989, in _disconnect_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     vol_driver.disconnect_volume(connection_info, instance)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/opt/stack/nova/nova/virt/libvirt/volume/iscsi.py", line 74, in disconnect_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     self.connector.disconnect_volume(connection_info['data'], None)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/utils.py", line 185, in trace_logging_wrapper
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     result = f(*args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py", line 78, in inner
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     return f(*args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/utils.py", line 387, in change_encrypted
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     res = func(**call_args)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 880, in disconnect_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     return self._cleanup_connection(connection_properties, force=force,
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 934, in _cleanup_connection
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     multipath_name = self._linuxscsi.remove_connection(
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 333, in remove_connection
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     self.remove_scsi_device(dev_path, force, exc, flush)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 81, in remove_scsi_device
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     self.flush_device_io(device)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 370, in flush_device_io
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     self._execute('blockdev', '--flushbufs', device,
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     result = self.__execute(*args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     return execute_root(*cmd, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     return self.channel.remote_call(name, args, kwargs,
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4]     raise exc_type(*result[2])
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Command: blockdev --flushbufs /dev/sdc
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Exit code: 1
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Stdout: ''
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n'
Apr 17 15:32:47 user nova-compute[82617]: ERROR nova.virt.block_device [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] 
Apr 17 15:32:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 60.819s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server [None req-2b9df0c8-3580-4263-8511-10a9b44d6cf0 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Exception during message handling: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:32:47 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdc
Apr 17 15:32:47 user nova-compute[82617]: Exit code: 1
Apr 17 15:32:47 user nova-compute[82617]: Stdout: ''
Apr 17 15:32:47 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n'
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7588, in detach_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     do_detach_volume(context, volume_id, instance, attachment_id)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7585, in do_detach_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._detach_volume(context, bdm, instance,
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7536, in _detach_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     driver_bdm.detach(context, instance, self.volume_api, self.driver,
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 538, in detach
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._do_detach(context, instance, volume_api, virt_driver,
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 459, in _do_detach
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.driver_detach(context, instance, volume_api, virt_driver)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 393, in driver_detach
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 379, in driver_detach
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     virt_driver.detach_volume(context, connection_info, instance, mp,
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 2723, in detach_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._disconnect_volume(context, connection_info, instance,
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1989, in _disconnect_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     vol_driver.disconnect_volume(connection_info, instance)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/volume/iscsi.py", line 74, in disconnect_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.connector.disconnect_volume(connection_info['data'], None)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/utils.py", line 185, in trace_logging_wrapper
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py", line 78, in inner
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/utils.py", line 387, in change_encrypted
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     res = func(**call_args)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 880, in disconnect_volume
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self._cleanup_connection(connection_properties, force=force,
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 934, in _cleanup_connection
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     multipath_name = self._linuxscsi.remove_connection(
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 333, in remove_connection
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.remove_scsi_device(dev_path, force, exc, flush)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 81, in remove_scsi_device
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self.flush_device_io(device)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py", line 370, in flush_device_io
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     self._execute('blockdev', '--flushbufs', device,
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     result = self.__execute(*args, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return execute_root(*cmd, **kwargs)
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     return self.channel.remote_call(name, args, kwargs,
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server     raise exc_type(*result[2])
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Command: blockdev --flushbufs /dev/sdc
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Exit code: 1
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Stdout: ''
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n'
Apr 17 15:32:47 user nova-compute[82617]: ERROR oslo_messaging.rpc.server 
Apr 17 15:32:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:32:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:32:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:32:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:32:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:32:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-ed93f249-f232-4329-941c-5fb301640eaf req-26541851-96b7-4be8-bec3-cd8a89bb5a32 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-changed-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-ed93f249-f232-4329-941c-5fb301640eaf req-26541851-96b7-4be8-bec3-cd8a89bb5a32 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Refreshing instance network info cache due to event network-changed-9468685e-6993-4a06-b2c8-8c7388ccf0eb. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ed93f249-f232-4329-941c-5fb301640eaf req-26541851-96b7-4be8-bec3-cd8a89bb5a32 service nova] Acquiring lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ed93f249-f232-4329-941c-5fb301640eaf req-26541851-96b7-4be8-bec3-cd8a89bb5a32 service nova] Acquired lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG nova.network.neutron [req-ed93f249-f232-4329-941c-5fb301640eaf req-26541851-96b7-4be8-bec3-cd8a89bb5a32 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Refreshing network info cache for port 9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:32:57 user nova-compute[82617]: INFO nova.compute.manager [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Terminating instance
Apr 17 15:32:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-b288d6b8-9b1a-46ad-a789-4c177fbdb939 req-e62405f2-dcf9-48c9-9d10-0196af2ed479 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-vif-unplugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b288d6b8-9b1a-46ad-a789-4c177fbdb939 req-e62405f2-dcf9-48c9-9d10-0196af2ed479 service nova] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b288d6b8-9b1a-46ad-a789-4c177fbdb939 req-e62405f2-dcf9-48c9-9d10-0196af2ed479 service nova] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b288d6b8-9b1a-46ad-a789-4c177fbdb939 req-e62405f2-dcf9-48c9-9d10-0196af2ed479 service nova] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-b288d6b8-9b1a-46ad-a789-4c177fbdb939 req-e62405f2-dcf9-48c9-9d10-0196af2ed479 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] No waiting events found dispatching network-vif-unplugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-b288d6b8-9b1a-46ad-a789-4c177fbdb939 req-e62405f2-dcf9-48c9-9d10-0196af2ed479 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-vif-unplugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:32:58 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Instance destroyed successfully.
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.objects.instance [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lazy-loading 'resources' on Instance uuid 05ccc225-01da-4975-97de-f1c0fbf20a50 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-473698875',display_name='tempest-TestStampPattern-server-473698875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-473698875',id=13,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpR6wTVozfzrg8ITIzsZSL0Xydku7Qt4lmPk8W4l8ULCcQqh9zp+t4PhSdrB5dj3a/e5LtbOYPXxHNSBb9u/7EwfWgkfQIl+7sCrEMiSKXHi0nmEFjdphHMWAA3ejP92w==',key_name='tempest-TestStampPattern-1190480106',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9ca6aeb2f184cd58cf4b4dde051bdbb',ramdisk_id='',reservation_id='r-iabk42h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-173447269',owner_user_name='tempest-TestStampPattern-173447269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:28:00Z,user_data=None,user_id='795213c1e99c46a7b6dd5512b1e9f48c',uuid=05ccc225-01da-4975-97de-f1c0fbf20a50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Converting VIF {"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:21:b9,bridge_name='br-int',has_traffic_filtering=True,id=9468685e-6993-4a06-b2c8-8c7388ccf0eb,network=Network(a8fac32a-80d6-4ead-8078-a99d620a3bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9468685e-69') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG os_vif [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:21:b9,bridge_name='br-int',has_traffic_filtering=True,id=9468685e-6993-4a06-b2c8-8c7388ccf0eb,network=Network(a8fac32a-80d6-4ead-8078-a99d620a3bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9468685e-69') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9468685e-69, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:32:58 user nova-compute[82617]: INFO os_vif [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:21:b9,bridge_name='br-int',has_traffic_filtering=True,id=9468685e-6993-4a06-b2c8-8c7388ccf0eb,network=Network(a8fac32a-80d6-4ead-8078-a99d620a3bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9468685e-69')
Apr 17 15:32:58 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Deleting instance files /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50_del
Apr 17 15:32:58 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Deletion of /opt/stack/data/nova/instances/05ccc225-01da-4975-97de-f1c0fbf20a50_del complete
Apr 17 15:32:58 user nova-compute[82617]: INFO nova.compute.manager [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 17 15:32:58 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.network.neutron [req-ed93f249-f232-4329-941c-5fb301640eaf req-26541851-96b7-4be8-bec3-cd8a89bb5a32 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updated VIF entry in instance network info cache for port 9468685e-6993-4a06-b2c8-8c7388ccf0eb. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG nova.network.neutron [req-ed93f249-f232-4329-941c-5fb301640eaf req-26541851-96b7-4be8-bec3-cd8a89bb5a32 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updating instance_info_cache with network_info: [{"id": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "address": "fa:16:3e:f5:21:b9", "network": {"id": "a8fac32a-80d6-4ead-8078-a99d620a3bba", "bridge": "br-int", "label": "tempest-TestStampPattern-186572187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9ca6aeb2f184cd58cf4b4dde051bdbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9468685e-69", "ovs_interfaceid": "9468685e-6993-4a06-b2c8-8c7388ccf0eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:32:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-ed93f249-f232-4329-941c-5fb301640eaf req-26541851-96b7-4be8-bec3-cd8a89bb5a32 service nova] Releasing lock "refresh_cache-05ccc225-01da-4975-97de-f1c0fbf20a50" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:32:59 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:32:59 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Took 0.53 seconds to deallocate network for instance.
Apr 17 15:32:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-52a87e9b-0c4d-4b3e-a1a4-cfbefb4e8e5d req-9fde0425-0196-41c9-af53-5f3131be4f55 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-vif-deleted-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:32:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:32:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:32:59 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:32:59 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:32:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:32:59 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Deleted allocations for instance 05ccc225-01da-4975-97de-f1c0fbf20a50
Apr 17 15:32:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-782a1aee-5948-45d6-bf54-224faa419a14 tempest-TestStampPattern-173447269 tempest-TestStampPattern-173447269-project-member] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.712s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:33:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-34320550-2acc-43b9-9b2f-f4e963752a2c req-20065f43-45cf-4121-8208-44450b3c7d00 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received event network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:33:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-34320550-2acc-43b9-9b2f-f4e963752a2c req-20065f43-45cf-4121-8208-44450b3c7d00 service nova] Acquiring lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:33:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-34320550-2acc-43b9-9b2f-f4e963752a2c req-20065f43-45cf-4121-8208-44450b3c7d00 service nova] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:33:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-34320550-2acc-43b9-9b2f-f4e963752a2c req-20065f43-45cf-4121-8208-44450b3c7d00 service nova] Lock "05ccc225-01da-4975-97de-f1c0fbf20a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:33:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-34320550-2acc-43b9-9b2f-f4e963752a2c req-20065f43-45cf-4121-8208-44450b3c7d00 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] No waiting events found dispatching network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:33:00 user nova-compute[82617]: WARNING nova.compute.manager [req-34320550-2acc-43b9-9b2f-f4e963752a2c req-20065f43-45cf-4121-8208-44450b3c7d00 service nova] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Received unexpected event network-vif-plugged-9468685e-6993-4a06-b2c8-8c7388ccf0eb for instance with vm_state deleted and task_state None.
Apr 17 15:33:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:13 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745578.391464, 05ccc225-01da-4975-97de-f1c0fbf20a50 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:33:13 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] VM Stopped (Lifecycle Event)
Apr 17 15:33:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b30ea520-8e6c-44f3-83d2-c296ca23a3b1 None None] [instance: 05ccc225-01da-4975-97de-f1c0fbf20a50] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:33:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:33:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:33:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:33:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:33:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:33:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:33:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8100MB free_disk=26.398269653320312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:33:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:33:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:33:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:33:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:33:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:33:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:33:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:33:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:33:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:33:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:33:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:33:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:01 user nova-compute[82617]: INFO nova.compute.manager [None req-8ba60f7d-c911-4afe-95c5-d62d308a23b7 tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Get console output
Apr 17 15:34:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:34:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:34:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:34:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8086MB free_disk=26.38616943359375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:34:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:34:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 15:34:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 15:34:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:34:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:34:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:34:39 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:34:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:40 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:34:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:34:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:34:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 15:34:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:34:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:34:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:34:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:34:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:34:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:34:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:34:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:31 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:35:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:35:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:35:33 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8043MB free_disk=26.379104614257812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance c0e53ff8-38c3-4353-a225-22ceae908f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:35:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:35:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:35:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:35:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "c0e53ff8-38c3-4353-a225-22ceae908f50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:35:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:35:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:35:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:35:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:35:42 user nova-compute[82617]: INFO nova.compute.manager [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Terminating instance
Apr 17 15:35:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:35:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.compute.manager [req-a0c233b9-84a3-400c-94f6-a145833607d3 req-7873360a-35da-428c-bffe-492e421246e2 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received event network-vif-unplugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a0c233b9-84a3-400c-94f6-a145833607d3 req-7873360a-35da-428c-bffe-492e421246e2 service nova] Acquiring lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a0c233b9-84a3-400c-94f6-a145833607d3 req-7873360a-35da-428c-bffe-492e421246e2 service nova] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a0c233b9-84a3-400c-94f6-a145833607d3 req-7873360a-35da-428c-bffe-492e421246e2 service nova] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.compute.manager [req-a0c233b9-84a3-400c-94f6-a145833607d3 req-7873360a-35da-428c-bffe-492e421246e2 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] No waiting events found dispatching network-vif-unplugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.compute.manager [req-a0c233b9-84a3-400c-94f6-a145833607d3 req-7873360a-35da-428c-bffe-492e421246e2 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received event network-vif-unplugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:43 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Instance destroyed successfully.
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.objects.instance [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'resources' on Instance uuid c0e53ff8-38c3-4353-a225-22ceae908f50 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-845854553',display_name='tempest-VolumesAdminNegativeTest-server-845854553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-845854553',id=12,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:27:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b334c5bc33f143c484518d9bd0e750dd',ramdisk_id='',reservation_id='r-n3dowwrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1285212149',owner_user_name='tempest-VolumesAdminNegativeTest-1285212149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:27:29Z,user_data=None,user_id='3dfadfd30c394b46abe75ec930007850',uuid=c0e53ff8-38c3-4353-a225-22ceae908f50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converting VIF {"id": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "address": "fa:16:3e:e7:2d:f4", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ee7dd3a-30", "ovs_interfaceid": "1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2d:f4,bridge_name='br-int',has_traffic_filtering=True,id=1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee7dd3a-30') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG os_vif [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2d:f4,bridge_name='br-int',has_traffic_filtering=True,id=1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee7dd3a-30') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ee7dd3a-30, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:43 user nova-compute[82617]: INFO os_vif [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2d:f4,bridge_name='br-int',has_traffic_filtering=True,id=1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ee7dd3a-30')
Apr 17 15:35:43 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Deleting instance files /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50_del
Apr 17 15:35:43 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Deletion of /opt/stack/data/nova/instances/c0e53ff8-38c3-4353-a225-22ceae908f50_del complete
Apr 17 15:35:43 user nova-compute[82617]: INFO nova.compute.manager [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 17 15:35:43 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:35:43 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:35:44 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:35:44 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Took 0.62 seconds to deallocate network for instance.
Apr 17 15:35:44 user nova-compute[82617]: DEBUG nova.compute.manager [req-bd8f3c32-9a99-4364-8a27-e73b51e448d4 req-bdb3869c-66e1-47bc-bc6c-477563f778db service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received event network-vif-deleted-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:35:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:35:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:35:44 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:35:44 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:35:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:35:44 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Deleted allocations for instance c0e53ff8-38c3-4353-a225-22ceae908f50
Apr 17 15:35:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-883e3f0e-b1ab-4f2e-8725-2d693df83699 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:35:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:45 user nova-compute[82617]: DEBUG nova.compute.manager [req-820e7374-68b8-4357-943c-c70b9a3b9e25 req-60f71b7e-8e6d-4257-af55-ab12e4fff5d5 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received event network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:35:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-820e7374-68b8-4357-943c-c70b9a3b9e25 req-60f71b7e-8e6d-4257-af55-ab12e4fff5d5 service nova] Acquiring lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:35:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-820e7374-68b8-4357-943c-c70b9a3b9e25 req-60f71b7e-8e6d-4257-af55-ab12e4fff5d5 service nova] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:35:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-820e7374-68b8-4357-943c-c70b9a3b9e25 req-60f71b7e-8e6d-4257-af55-ab12e4fff5d5 service nova] Lock "c0e53ff8-38c3-4353-a225-22ceae908f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:35:45 user nova-compute[82617]: DEBUG nova.compute.manager [req-820e7374-68b8-4357-943c-c70b9a3b9e25 req-60f71b7e-8e6d-4257-af55-ab12e4fff5d5 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] No waiting events found dispatching network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:35:45 user nova-compute[82617]: WARNING nova.compute.manager [req-820e7374-68b8-4357-943c-c70b9a3b9e25 req-60f71b7e-8e6d-4257-af55-ab12e4fff5d5 service nova] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Received unexpected event network-vif-plugged-1ee7dd3a-3017-4a91-9e2c-5fec5e6727c6 for instance with vm_state deleted and task_state None.
Apr 17 15:35:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:35:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:35:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:35:58 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745743.6072106, c0e53ff8-38c3-4353-a225-22ceae908f50 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:35:58 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] VM Stopped (Lifecycle Event)
Apr 17 15:35:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-96c9618d-216f-4376-995f-e98570c6bcde None None] [instance: c0e53ff8-38c3-4353-a225-22ceae908f50] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:35:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:36:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:36:34 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:36:34 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8183MB free_disk=26.385623931884766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:36:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:36:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:36:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updating instance_info_cache with network_info: [{"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-df469608-5f17-4f70-8933-fe92adcd3837" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:36:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:36:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:36:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:36:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:36:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:36:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:36:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:37:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:37:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:37:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:37:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:37:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:37:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:37:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:37:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:37:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:37:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:37:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8169MB free_disk=26.382003784179688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:37:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:37:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:37:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:37:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updating instance_info_cache with network_info: [{"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:37:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:37:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:37:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:38:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:38:11 user nova-compute[82617]: INFO nova.compute.manager [None req-1319df12-3326-46bb-802d-f8f7c4d881ee tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Get console output
Apr 17 15:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:38:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:38:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:38:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:38:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8185MB free_disk=26.366973876953125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance df469608-5f17-4f70-8933-fe92adcd3837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:38:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:38:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:38:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:38:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:38:52 user nova-compute[82617]: INFO nova.compute.manager [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Terminating instance
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-286f8ade-a65a-421b-8662-35766be1a737 req-38c2d405-de98-4949-bdf0-cf848ec3d8b0 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received event network-vif-unplugged-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-286f8ade-a65a-421b-8662-35766be1a737 req-38c2d405-de98-4949-bdf0-cf848ec3d8b0 service nova] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-286f8ade-a65a-421b-8662-35766be1a737 req-38c2d405-de98-4949-bdf0-cf848ec3d8b0 service nova] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-286f8ade-a65a-421b-8662-35766be1a737 req-38c2d405-de98-4949-bdf0-cf848ec3d8b0 service nova] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-286f8ade-a65a-421b-8662-35766be1a737 req-38c2d405-de98-4949-bdf0-cf848ec3d8b0 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] No waiting events found dispatching network-vif-unplugged-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-286f8ade-a65a-421b-8662-35766be1a737 req-38c2d405-de98-4949-bdf0-cf848ec3d8b0 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received event network-vif-unplugged-5ff3398f-eb1e-477e-9678-d331ee7f278d for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:38:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Instance destroyed successfully.
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lazy-loading 'resources' on Instance uuid df469608-5f17-4f70-8933-fe92adcd3837 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-858667918',display_name='tempest-VolumesAdminNegativeTest-server-858667918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-858667918',id=5,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1Hsqi4glC0WnZUxbiqM+S05blTE/Rza3njT70e8v0X40Wh/Q58QfGz7PEUqNtnXSOLvs6KHX/N52iy6W4+ahSFVrr8wn6IDPOAH2vAAvNq7O5MyAbb1mZiXcBOGsHKJg==',key_name='tempest-keypair-225894771',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b334c5bc33f143c484518d9bd0e750dd',ramdisk_id='',reservation_id='r-p8d0ze59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1285212149',owner_user_name='tempest-VolumesAdminNegativeTest-1285212149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:24:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dfadfd30c394b46abe75ec930007850',uuid=df469608-5f17-4f70-8933-fe92adcd3837,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converting VIF {"id": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "address": "fa:16:3e:61:76:e7", "network": {"id": "b223c50e-bdb4-466e-9235-0eccbc10ab91", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-273990954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b334c5bc33f143c484518d9bd0e750dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff3398f-eb", "ovs_interfaceid": "5ff3398f-eb1e-477e-9678-d331ee7f278d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:76:e7,bridge_name='br-int',has_traffic_filtering=True,id=5ff3398f-eb1e-477e-9678-d331ee7f278d,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff3398f-eb') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG os_vif [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:76:e7,bridge_name='br-int',has_traffic_filtering=True,id=5ff3398f-eb1e-477e-9678-d331ee7f278d,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff3398f-eb') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ff3398f-eb, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:38:52 user nova-compute[82617]: INFO os_vif [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:76:e7,bridge_name='br-int',has_traffic_filtering=True,id=5ff3398f-eb1e-477e-9678-d331ee7f278d,network=Network(b223c50e-bdb4-466e-9235-0eccbc10ab91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff3398f-eb')
Apr 17 15:38:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Deleting instance files /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837_del
Apr 17 15:38:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Deletion of /opt/stack/data/nova/instances/df469608-5f17-4f70-8933-fe92adcd3837_del complete
Apr 17 15:38:52 user nova-compute[82617]: INFO nova.compute.manager [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 17 15:38:52 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:38:52 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: df469608-5f17-4f70-8933-fe92adcd3837] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:38:53 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:38:53 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Took 0.89 seconds to deallocate network for instance.
Apr 17 15:38:53 user nova-compute[82617]: DEBUG nova.compute.manager [req-57e09968-b577-4521-ad61-656881d8c977 req-3d9bbe93-cc01-44e7-b9e6-195b4ff4f5e9 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received event network-vif-deleted-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:38:53 user nova-compute[82617]: INFO nova.compute.manager [req-57e09968-b577-4521-ad61-656881d8c977 req-3d9bbe93-cc01-44e7-b9e6-195b4ff4f5e9 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Neutron deleted interface 5ff3398f-eb1e-477e-9678-d331ee7f278d; detaching it from the instance and deleting it from the info cache
Apr 17 15:38:53 user nova-compute[82617]: DEBUG nova.network.neutron [req-57e09968-b577-4521-ad61-656881d8c977 req-3d9bbe93-cc01-44e7-b9e6-195b4ff4f5e9 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:38:53 user nova-compute[82617]: DEBUG nova.compute.manager [req-57e09968-b577-4521-ad61-656881d8c977 req-3d9bbe93-cc01-44e7-b9e6-195b4ff4f5e9 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Detach interface failed, port_id=5ff3398f-eb1e-477e-9678-d331ee7f278d, reason: Instance df469608-5f17-4f70-8933-fe92adcd3837 could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:38:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:38:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:38:54 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:38:54 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:38:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:38:54 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Deleted allocations for instance df469608-5f17-4f70-8933-fe92adcd3837
Apr 17 15:38:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-30b32bcc-4ef9-4fab-aaaf-7e5df01b1466 tempest-VolumesAdminNegativeTest-1285212149 tempest-VolumesAdminNegativeTest-1285212149-project-member] Lock "df469608-5f17-4f70-8933-fe92adcd3837" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:38:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-81a9b4c9-2f5f-4179-87d3-40117a607583 req-5852789b-e3a0-4338-81cb-95e2f9514922 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received event network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:38:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-81a9b4c9-2f5f-4179-87d3-40117a607583 req-5852789b-e3a0-4338-81cb-95e2f9514922 service nova] Acquiring lock "df469608-5f17-4f70-8933-fe92adcd3837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:38:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-81a9b4c9-2f5f-4179-87d3-40117a607583 req-5852789b-e3a0-4338-81cb-95e2f9514922 service nova] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:38:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-81a9b4c9-2f5f-4179-87d3-40117a607583 req-5852789b-e3a0-4338-81cb-95e2f9514922 service nova] Lock "df469608-5f17-4f70-8933-fe92adcd3837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:38:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-81a9b4c9-2f5f-4179-87d3-40117a607583 req-5852789b-e3a0-4338-81cb-95e2f9514922 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] No waiting events found dispatching network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:38:54 user nova-compute[82617]: WARNING nova.compute.manager [req-81a9b4c9-2f5f-4179-87d3-40117a607583 req-5852789b-e3a0-4338-81cb-95e2f9514922 service nova] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Received unexpected event network-vif-plugged-5ff3398f-eb1e-477e-9678-d331ee7f278d for instance with vm_state deleted and task_state None.
Apr 17 15:38:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:39:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:39:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:39:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:39:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:07 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681745932.7792878, df469608-5f17-4f70-8933-fe92adcd3837 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:39:07 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: df469608-5f17-4f70-8933-fe92adcd3837] VM Stopped (Lifecycle Event)
Apr 17 15:39:07 user nova-compute[82617]: DEBUG nova.compute.manager [None req-c4ba467e-b9fc-46f9-bd83-bc4e1ea9c2f1 None None] [instance: df469608-5f17-4f70-8933-fe92adcd3837] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:39:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:39:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:39:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:39:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:39:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:39:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:39:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:39:35 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:39:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:39:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8235MB free_disk=26.37615966796875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:39:36 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:39:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:39:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:39:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 15:39:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 15:39:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:39:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:39:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:39:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:39:46 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:39:47 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:39:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:39:47 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:39:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 15:39:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:39:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:39:59 user nova-compute[82617]: INFO nova.compute.claims [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Claim successful on node user
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:39:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:39:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:39:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Creating image(s)
Apr 17 15:39:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "/opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "/opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk 1073741824" returned: 0 in 0.049s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:40:00 user nova-compute[82617]: INFO nova.compute.claims [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Claim successful on node user
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.policy [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e3487d6b32d46beac556617050fd664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9324c99bd4d040bdb5a7f1db782b2783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:00 user nova-compute[82617]: WARNING nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid aa603d40-37aa-47b1-a289-7c7c4f582f94 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Cannot resize image /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.objects.instance [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'migration_context' on Instance uuid aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Ensure instance console log exists: /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.network.neutron [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:40:00 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:40:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:40:01 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Creating image(s)
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.policy [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e3487d6b32d46beac556617050fd664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9324c99bd4d040bdb5a7f1db782b2783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Successfully created port: 15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk 1073741824" returned: 0 in 0.052s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Cannot resize image /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.objects.instance [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'migration_context' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Ensure instance console log exists: /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG nova.network.neutron [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Successfully created port: 34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Successfully updated port: 15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquired lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG nova.compute.manager [req-992b869a-3579-4d5a-ae70-d5bb1ff554fe req-6d8ef93f-30d1-48f8-84dc-0b5f2d995a9f service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received event network-changed-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG nova.compute.manager [req-992b869a-3579-4d5a-ae70-d5bb1ff554fe req-6d8ef93f-30d1-48f8-84dc-0b5f2d995a9f service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Refreshing instance network info cache due to event network-changed-15293fd3-2a49-42bb-ab80-de44a94a83c5. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-992b869a-3579-4d5a-ae70-d5bb1ff554fe req-6d8ef93f-30d1-48f8-84dc-0b5f2d995a9f service nova] Acquiring lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:40:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Successfully updated port: 34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquired lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updating instance_info_cache with network_info: [{"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Releasing lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Instance network_info: |[{"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-992b869a-3579-4d5a-ae70-d5bb1ff554fe req-6d8ef93f-30d1-48f8-84dc-0b5f2d995a9f service nova] Acquired lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.neutron [req-992b869a-3579-4d5a-ae70-d5bb1ff554fe req-6d8ef93f-30d1-48f8-84dc-0b5f2d995a9f service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Refreshing network info cache for port 15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Start _get_guest_xml network_info=[{"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:40:03 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:40:03 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-310684687',display_name='tempest-ServerRescueNegativeTestJSON-server-310684687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-310684687',id=16,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9324c99bd4d040bdb5a7f1db782b2783',ramdisk_id='',reservation_id='r-7atsda10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1346397943',owner_user_name='tempest-ServerRescueNegativeTestJSON-1346397943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:40:00Z,user_data=None,user_id='8e3487d6b32d46beac556617050fd664',uuid=aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converting VIF {"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:64,bridge_name='br-int',has_traffic_filtering=True,id=15293fd3-2a49-42bb-ab80-de44a94a83c5,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15293fd3-2a') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.objects.instance [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'pci_devices' on Instance uuid aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:40:03 user nova-compute[82617]:   <uuid>aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a</uuid>
Apr 17 15:40:03 user nova-compute[82617]:   <name>instance-00000010</name>
Apr 17 15:40:03 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:40:03 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:40:03 user nova-compute[82617]:   <metadata>
Apr 17 15:40:03 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:40:03 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:40:03 user nova-compute[82617]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-310684687</nova:name>
Apr 17 15:40:03 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:40:03</nova:creationTime>
Apr 17 15:40:03 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:40:03 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:40:03 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:40:03 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:40:03 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:40:03 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:40:03 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:40:03 user nova-compute[82617]:       <nova:owner>
Apr 17 15:40:03 user nova-compute[82617]:         <nova:user uuid="8e3487d6b32d46beac556617050fd664">tempest-ServerRescueNegativeTestJSON-1346397943-project-member</nova:user>
Apr 17 15:40:03 user nova-compute[82617]:         <nova:project uuid="9324c99bd4d040bdb5a7f1db782b2783">tempest-ServerRescueNegativeTestJSON-1346397943</nova:project>
Apr 17 15:40:03 user nova-compute[82617]:       </nova:owner>
Apr 17 15:40:03 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:40:03 user nova-compute[82617]:       <nova:ports>
Apr 17 15:40:03 user nova-compute[82617]:         <nova:port uuid="15293fd3-2a49-42bb-ab80-de44a94a83c5">
Apr 17 15:40:03 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 15:40:03 user nova-compute[82617]:         </nova:port>
Apr 17 15:40:03 user nova-compute[82617]:       </nova:ports>
Apr 17 15:40:03 user nova-compute[82617]:     </nova:instance>
Apr 17 15:40:03 user nova-compute[82617]:   </metadata>
Apr 17 15:40:03 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:40:03 user nova-compute[82617]:     <system>
Apr 17 15:40:03 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:40:03 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:40:03 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:40:03 user nova-compute[82617]:       <entry name="serial">aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a</entry>
Apr 17 15:40:03 user nova-compute[82617]:       <entry name="uuid">aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a</entry>
Apr 17 15:40:03 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:40:03 user nova-compute[82617]:     </system>
Apr 17 15:40:03 user nova-compute[82617]:   </sysinfo>
Apr 17 15:40:03 user nova-compute[82617]:   <os>
Apr 17 15:40:03 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:40:03 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:40:03 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:40:03 user nova-compute[82617]:   </os>
Apr 17 15:40:03 user nova-compute[82617]:   <features>
Apr 17 15:40:03 user nova-compute[82617]:     <acpi/>
Apr 17 15:40:03 user nova-compute[82617]:     <apic/>
Apr 17 15:40:03 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:40:03 user nova-compute[82617]:   </features>
Apr 17 15:40:03 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:40:03 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:40:03 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:40:03 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:40:03 user nova-compute[82617]:   </clock>
Apr 17 15:40:03 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:40:03 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:40:03 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:40:03 user nova-compute[82617]:   </cpu>
Apr 17 15:40:03 user nova-compute[82617]:   <devices>
Apr 17 15:40:03 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:40:03 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:40:03 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk"/>
Apr 17 15:40:03 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:40:03 user nova-compute[82617]:     </disk>
Apr 17 15:40:03 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:40:03 user nova-compute[82617]:       <mac address="fa:16:3e:1b:58:64"/>
Apr 17 15:40:03 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:40:03 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:40:03 user nova-compute[82617]:       <target dev="tap15293fd3-2a"/>
Apr 17 15:40:03 user nova-compute[82617]:     </interface>
Apr 17 15:40:03 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:40:03 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/console.log" append="off"/>
Apr 17 15:40:03 user nova-compute[82617]:     </serial>
Apr 17 15:40:03 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:40:03 user nova-compute[82617]:     <video>
Apr 17 15:40:03 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:40:03 user nova-compute[82617]:     </video>
Apr 17 15:40:03 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:40:03 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:40:03 user nova-compute[82617]:     </rng>
Apr 17 15:40:03 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:40:03 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:40:03 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:40:03 user nova-compute[82617]:     </memballoon>
Apr 17 15:40:03 user nova-compute[82617]:   </devices>
Apr 17 15:40:03 user nova-compute[82617]: </domain>
Apr 17 15:40:03 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-310684687',display_name='tempest-ServerRescueNegativeTestJSON-server-310684687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-310684687',id=16,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9324c99bd4d040bdb5a7f1db782b2783',ramdisk_id='',reservation_id='r-7atsda10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1346397943',owner_user_name='tempest-ServerRescueNegativeTestJSON-1346397943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:40:00Z,user_data=None,user_id='8e3487d6b32d46beac556617050fd664',uuid=aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converting VIF {"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:64,bridge_name='br-int',has_traffic_filtering=True,id=15293fd3-2a49-42bb-ab80-de44a94a83c5,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15293fd3-2a') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG os_vif [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:64,bridge_name='br-int',has_traffic_filtering=True,id=15293fd3-2a49-42bb-ab80-de44a94a83c5,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15293fd3-2a') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15293fd3-2a, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15293fd3-2a, col_values=(('external_ids', {'iface-id': '15293fd3-2a49-42bb-ab80-de44a94a83c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:58:64', 'vm-uuid': 'aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:03 user nova-compute[82617]: INFO os_vif [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:64,bridge_name='br-int',has_traffic_filtering=True,id=15293fd3-2a49-42bb-ab80-de44a94a83c5,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15293fd3-2a')
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:40:03 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] No VIF found with MAC fa:16:3e:1b:58:64, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updating instance_info_cache with network_info: [{"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Releasing lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Instance network_info: |[{"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Start _get_guest_xml network_info=[{"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:40:04 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:40:04 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1266906511',display_name='tempest-ServerRescueNegativeTestJSON-server-1266906511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1266906511',id=17,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9324c99bd4d040bdb5a7f1db782b2783',ramdisk_id='',reservation_id='r-5af3f2wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1346397943',owner_user_name='tempest-ServerRescueNegativeTestJSON-1346397943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:40:01Z,user_data=None,user_id='8e3487d6b32d46beac556617050fd664',uuid=f67fa07e-0d72-4fc4-a96a-9271dd8e340b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converting VIF {"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:09:af,bridge_name='br-int',has_traffic_filtering=True,id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ec3ccd-f3') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.objects.instance [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'pci_devices' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:40:04 user nova-compute[82617]:   <uuid>f67fa07e-0d72-4fc4-a96a-9271dd8e340b</uuid>
Apr 17 15:40:04 user nova-compute[82617]:   <name>instance-00000011</name>
Apr 17 15:40:04 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:40:04 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:40:04 user nova-compute[82617]:   <metadata>
Apr 17 15:40:04 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:40:04 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:40:04 user nova-compute[82617]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1266906511</nova:name>
Apr 17 15:40:04 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:40:04</nova:creationTime>
Apr 17 15:40:04 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:40:04 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:40:04 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:40:04 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:40:04 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:40:04 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:40:04 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:40:04 user nova-compute[82617]:       <nova:owner>
Apr 17 15:40:04 user nova-compute[82617]:         <nova:user uuid="8e3487d6b32d46beac556617050fd664">tempest-ServerRescueNegativeTestJSON-1346397943-project-member</nova:user>
Apr 17 15:40:04 user nova-compute[82617]:         <nova:project uuid="9324c99bd4d040bdb5a7f1db782b2783">tempest-ServerRescueNegativeTestJSON-1346397943</nova:project>
Apr 17 15:40:04 user nova-compute[82617]:       </nova:owner>
Apr 17 15:40:04 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:40:04 user nova-compute[82617]:       <nova:ports>
Apr 17 15:40:04 user nova-compute[82617]:         <nova:port uuid="34ec3ccd-f3eb-4481-85c5-90b55f4c2c67">
Apr 17 15:40:04 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 15:40:04 user nova-compute[82617]:         </nova:port>
Apr 17 15:40:04 user nova-compute[82617]:       </nova:ports>
Apr 17 15:40:04 user nova-compute[82617]:     </nova:instance>
Apr 17 15:40:04 user nova-compute[82617]:   </metadata>
Apr 17 15:40:04 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:40:04 user nova-compute[82617]:     <system>
Apr 17 15:40:04 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:40:04 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:40:04 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:40:04 user nova-compute[82617]:       <entry name="serial">f67fa07e-0d72-4fc4-a96a-9271dd8e340b</entry>
Apr 17 15:40:04 user nova-compute[82617]:       <entry name="uuid">f67fa07e-0d72-4fc4-a96a-9271dd8e340b</entry>
Apr 17 15:40:04 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:40:04 user nova-compute[82617]:     </system>
Apr 17 15:40:04 user nova-compute[82617]:   </sysinfo>
Apr 17 15:40:04 user nova-compute[82617]:   <os>
Apr 17 15:40:04 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:40:04 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:40:04 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:40:04 user nova-compute[82617]:   </os>
Apr 17 15:40:04 user nova-compute[82617]:   <features>
Apr 17 15:40:04 user nova-compute[82617]:     <acpi/>
Apr 17 15:40:04 user nova-compute[82617]:     <apic/>
Apr 17 15:40:04 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:40:04 user nova-compute[82617]:   </features>
Apr 17 15:40:04 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:40:04 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:40:04 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:40:04 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:40:04 user nova-compute[82617]:   </clock>
Apr 17 15:40:04 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:40:04 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:40:04 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:40:04 user nova-compute[82617]:   </cpu>
Apr 17 15:40:04 user nova-compute[82617]:   <devices>
Apr 17 15:40:04 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:40:04 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:40:04 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk"/>
Apr 17 15:40:04 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:40:04 user nova-compute[82617]:     </disk>
Apr 17 15:40:04 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:40:04 user nova-compute[82617]:       <mac address="fa:16:3e:41:09:af"/>
Apr 17 15:40:04 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:40:04 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:40:04 user nova-compute[82617]:       <target dev="tap34ec3ccd-f3"/>
Apr 17 15:40:04 user nova-compute[82617]:     </interface>
Apr 17 15:40:04 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:40:04 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/console.log" append="off"/>
Apr 17 15:40:04 user nova-compute[82617]:     </serial>
Apr 17 15:40:04 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:40:04 user nova-compute[82617]:     <video>
Apr 17 15:40:04 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:40:04 user nova-compute[82617]:     </video>
Apr 17 15:40:04 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:40:04 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:40:04 user nova-compute[82617]:     </rng>
Apr 17 15:40:04 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:40:04 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:40:04 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:40:04 user nova-compute[82617]:     </memballoon>
Apr 17 15:40:04 user nova-compute[82617]:   </devices>
Apr 17 15:40:04 user nova-compute[82617]: </domain>
Apr 17 15:40:04 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1266906511',display_name='tempest-ServerRescueNegativeTestJSON-server-1266906511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1266906511',id=17,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9324c99bd4d040bdb5a7f1db782b2783',ramdisk_id='',reservation_id='r-5af3f2wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1346397943',owner_user_name='tempest-ServerRescueNegativeTestJSON-1346397943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:40:01Z,user_data=None,user_id='8e3487d6b32d46beac556617050fd664',uuid=f67fa07e-0d72-4fc4-a96a-9271dd8e340b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converting VIF {"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:09:af,bridge_name='br-int',has_traffic_filtering=True,id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ec3ccd-f3') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG os_vif [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:09:af,bridge_name='br-int',has_traffic_filtering=True,id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ec3ccd-f3') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34ec3ccd-f3, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34ec3ccd-f3, col_values=(('external_ids', {'iface-id': '34ec3ccd-f3eb-4481-85c5-90b55f4c2c67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:09:af', 'vm-uuid': 'f67fa07e-0d72-4fc4-a96a-9271dd8e340b'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-992b869a-3579-4d5a-ae70-d5bb1ff554fe req-6d8ef93f-30d1-48f8-84dc-0b5f2d995a9f service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updated VIF entry in instance network info cache for port 15293fd3-2a49-42bb-ab80-de44a94a83c5. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-992b869a-3579-4d5a-ae70-d5bb1ff554fe req-6d8ef93f-30d1-48f8-84dc-0b5f2d995a9f service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updating instance_info_cache with network_info: [{"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-992b869a-3579-4d5a-ae70-d5bb1ff554fe req-6d8ef93f-30d1-48f8-84dc-0b5f2d995a9f service nova] Releasing lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:04 user nova-compute[82617]: INFO os_vif [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:09:af,bridge_name='br-int',has_traffic_filtering=True,id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ec3ccd-f3')
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] No VIF found with MAC fa:16:3e:41:09:af, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.compute.manager [req-f0d93f06-ba78-4476-8e62-5f1ee394fb78 req-6490648e-e979-4054-9348-2dcff759e0bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-changed-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.compute.manager [req-f0d93f06-ba78-4476-8e62-5f1ee394fb78 req-6490648e-e979-4054-9348-2dcff759e0bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Refreshing instance network info cache due to event network-changed-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f0d93f06-ba78-4476-8e62-5f1ee394fb78 req-6490648e-e979-4054-9348-2dcff759e0bb service nova] Acquiring lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f0d93f06-ba78-4476-8e62-5f1ee394fb78 req-6490648e-e979-4054-9348-2dcff759e0bb service nova] Acquired lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-f0d93f06-ba78-4476-8e62-5f1ee394fb78 req-6490648e-e979-4054-9348-2dcff759e0bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Refreshing network info cache for port 34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG nova.compute.manager [req-88ebd515-7ff2-4827-815a-84ff39c970bf req-01bbf50a-a5a2-48cf-895b-931e2cf19b60 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received event network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-88ebd515-7ff2-4827-815a-84ff39c970bf req-01bbf50a-a5a2-48cf-895b-931e2cf19b60 service nova] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-88ebd515-7ff2-4827-815a-84ff39c970bf req-01bbf50a-a5a2-48cf-895b-931e2cf19b60 service nova] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-88ebd515-7ff2-4827-815a-84ff39c970bf req-01bbf50a-a5a2-48cf-895b-931e2cf19b60 service nova] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG nova.compute.manager [req-88ebd515-7ff2-4827-815a-84ff39c970bf req-01bbf50a-a5a2-48cf-895b-931e2cf19b60 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] No waiting events found dispatching network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:40:05 user nova-compute[82617]: WARNING nova.compute.manager [req-88ebd515-7ff2-4827-815a-84ff39c970bf req-01bbf50a-a5a2-48cf-895b-931e2cf19b60 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received unexpected event network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 for instance with vm_state building and task_state spawning.
Apr 17 15:40:05 user nova-compute[82617]: DEBUG nova.network.neutron [req-f0d93f06-ba78-4476-8e62-5f1ee394fb78 req-6490648e-e979-4054-9348-2dcff759e0bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updated VIF entry in instance network info cache for port 34ec3ccd-f3eb-4481-85c5-90b55f4c2c67. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG nova.network.neutron [req-f0d93f06-ba78-4476-8e62-5f1ee394fb78 req-6490648e-e979-4054-9348-2dcff759e0bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updating instance_info_cache with network_info: [{"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f0d93f06-ba78-4476-8e62-5f1ee394fb78 req-6490648e-e979-4054-9348-2dcff759e0bb service nova] Releasing lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received event network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] No waiting events found dispatching network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:40:07 user nova-compute[82617]: WARNING nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received unexpected event network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 for instance with vm_state building and task_state spawning.
Apr 17 15:40:07 user nova-compute[82617]: DEBUG nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] No waiting events found dispatching network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:40:07 user nova-compute[82617]: WARNING nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received unexpected event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 for instance with vm_state building and task_state spawning.
Apr 17 15:40:07 user nova-compute[82617]: DEBUG nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:07 user nova-compute[82617]: DEBUG nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] No waiting events found dispatching network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:40:07 user nova-compute[82617]: WARNING nova.compute.manager [req-e226aa68-4dd5-419e-aa45-42e5c6875d58 req-a9d70bb2-4602-45c6-9c8b-515dbe1c20d4 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received unexpected event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 for instance with vm_state building and task_state spawning.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746008.3341467, aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] VM Resumed (Lifecycle Event)
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Instance spawned successfully.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746008.3354144, aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] VM Started (Lifecycle Event)
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Instance spawned successfully.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Took 8.46 seconds to spawn the instance on the hypervisor.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746008.4148092, f67fa07e-0d72-4fc4-a96a-9271dd8e340b => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] VM Resumed (Lifecycle Event)
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746008.4171574, f67fa07e-0d72-4fc4-a96a-9271dd8e340b => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] VM Started (Lifecycle Event)
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Took 7.54 seconds to spawn the instance on the hypervisor.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Took 9.12 seconds to build instance.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8d6bea95-4a16-4930-9618-11a44cc077ef tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.219s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.100s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:40:08 user nova-compute[82617]: INFO nova.compute.manager [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Took 8.35 seconds to build instance.
Apr 17 15:40:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-d48503e0-ad0d-4898-8fd4-cd2f78b1d8bb tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.450s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:40:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:40:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:40:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:40:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:40:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:40:38 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:40:38 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=26.331546783447266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:40:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:40:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:40:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:40:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:47 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:40:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:40:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:40:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:40:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:03 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:41:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:41:03 user nova-compute[82617]: INFO nova.compute.claims [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Claim successful on node user
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:04 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:41:04 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Creating image(s)
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "/opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "/opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "/opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.policy [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd819e3f51368413c99691d1b45bbcfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540826be4baf46dba9617b2fd47821a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk 1073741824" returned: 0 in 0.046s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Cannot resize image /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG nova.objects.instance [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lazy-loading 'migration_context' on Instance uuid 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Ensure instance console log exists: /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:05 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Successfully created port: 5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Successfully updated port: 5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquired lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.compute.manager [req-2f71e2a3-2de1-4543-99bc-7458422ef362 req-a131e604-6415-4e60-aaf6-8b8b0fe5311f service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received event network-changed-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.compute.manager [req-2f71e2a3-2de1-4543-99bc-7458422ef362 req-a131e604-6415-4e60-aaf6-8b8b0fe5311f service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Refreshing instance network info cache due to event network-changed-5384bf0b-7657-4d2f-b395-c76db88f5f6f. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2f71e2a3-2de1-4543-99bc-7458422ef362 req-a131e604-6415-4e60-aaf6-8b8b0fe5311f service nova] Acquiring lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.neutron [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updating instance_info_cache with network_info: [{"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Releasing lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Instance network_info: |[{"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2f71e2a3-2de1-4543-99bc-7458422ef362 req-a131e604-6415-4e60-aaf6-8b8b0fe5311f service nova] Acquired lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-2f71e2a3-2de1-4543-99bc-7458422ef362 req-a131e604-6415-4e60-aaf6-8b8b0fe5311f service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Refreshing network info cache for port 5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Start _get_guest_xml network_info=[{"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:41:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:41:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2021873803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2021873803',id=18,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540826be4baf46dba9617b2fd47821a3',ramdisk_id='',reservation_id='r-u2ewglfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:41:04Z,user_data=None,user_id='d819e3f51368413c99691d1b45bbcfb1',uuid=1be3ec86-a922-4c20-94da-d2bbdc70dcd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converting VIF {"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5384bf0b-7657-4d2f-b395-c76db88f5f6f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5384bf0b-76') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.objects.instance [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lazy-loading 'pci_devices' on Instance uuid 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:41:06 user nova-compute[82617]:   <uuid>1be3ec86-a922-4c20-94da-d2bbdc70dcd6</uuid>
Apr 17 15:41:06 user nova-compute[82617]:   <name>instance-00000012</name>
Apr 17 15:41:06 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:41:06 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:41:06 user nova-compute[82617]:   <metadata>
Apr 17 15:41:06 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:41:06 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:41:06 user nova-compute[82617]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2021873803</nova:name>
Apr 17 15:41:06 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:41:06</nova:creationTime>
Apr 17 15:41:06 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:41:06 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:41:06 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:41:06 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:41:06 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:41:06 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:41:06 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:41:06 user nova-compute[82617]:       <nova:owner>
Apr 17 15:41:06 user nova-compute[82617]:         <nova:user uuid="d819e3f51368413c99691d1b45bbcfb1">tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member</nova:user>
Apr 17 15:41:06 user nova-compute[82617]:         <nova:project uuid="540826be4baf46dba9617b2fd47821a3">tempest-ServerBootFromVolumeStableRescueTest-1271370980</nova:project>
Apr 17 15:41:06 user nova-compute[82617]:       </nova:owner>
Apr 17 15:41:06 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:41:06 user nova-compute[82617]:       <nova:ports>
Apr 17 15:41:06 user nova-compute[82617]:         <nova:port uuid="5384bf0b-7657-4d2f-b395-c76db88f5f6f">
Apr 17 15:41:06 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 15:41:06 user nova-compute[82617]:         </nova:port>
Apr 17 15:41:06 user nova-compute[82617]:       </nova:ports>
Apr 17 15:41:06 user nova-compute[82617]:     </nova:instance>
Apr 17 15:41:06 user nova-compute[82617]:   </metadata>
Apr 17 15:41:06 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:41:06 user nova-compute[82617]:     <system>
Apr 17 15:41:06 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:41:06 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:41:06 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:41:06 user nova-compute[82617]:       <entry name="serial">1be3ec86-a922-4c20-94da-d2bbdc70dcd6</entry>
Apr 17 15:41:06 user nova-compute[82617]:       <entry name="uuid">1be3ec86-a922-4c20-94da-d2bbdc70dcd6</entry>
Apr 17 15:41:06 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:41:06 user nova-compute[82617]:     </system>
Apr 17 15:41:06 user nova-compute[82617]:   </sysinfo>
Apr 17 15:41:06 user nova-compute[82617]:   <os>
Apr 17 15:41:06 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:41:06 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:41:06 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:41:06 user nova-compute[82617]:   </os>
Apr 17 15:41:06 user nova-compute[82617]:   <features>
Apr 17 15:41:06 user nova-compute[82617]:     <acpi/>
Apr 17 15:41:06 user nova-compute[82617]:     <apic/>
Apr 17 15:41:06 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:41:06 user nova-compute[82617]:   </features>
Apr 17 15:41:06 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:41:06 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:41:06 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:41:06 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:41:06 user nova-compute[82617]:   </clock>
Apr 17 15:41:06 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:41:06 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:41:06 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:41:06 user nova-compute[82617]:   </cpu>
Apr 17 15:41:06 user nova-compute[82617]:   <devices>
Apr 17 15:41:06 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:41:06 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:41:06 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk"/>
Apr 17 15:41:06 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:41:06 user nova-compute[82617]:     </disk>
Apr 17 15:41:06 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:41:06 user nova-compute[82617]:       <mac address="fa:16:3e:04:b5:bc"/>
Apr 17 15:41:06 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:41:06 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:41:06 user nova-compute[82617]:       <target dev="tap5384bf0b-76"/>
Apr 17 15:41:06 user nova-compute[82617]:     </interface>
Apr 17 15:41:06 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:41:06 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/console.log" append="off"/>
Apr 17 15:41:06 user nova-compute[82617]:     </serial>
Apr 17 15:41:06 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:41:06 user nova-compute[82617]:     <video>
Apr 17 15:41:06 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:41:06 user nova-compute[82617]:     </video>
Apr 17 15:41:06 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:41:06 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:41:06 user nova-compute[82617]:     </rng>
Apr 17 15:41:06 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:41:06 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:41:06 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:41:06 user nova-compute[82617]:     </memballoon>
Apr 17 15:41:06 user nova-compute[82617]:   </devices>
Apr 17 15:41:06 user nova-compute[82617]: </domain>
Apr 17 15:41:06 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2021873803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2021873803',id=18,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540826be4baf46dba9617b2fd47821a3',ramdisk_id='',reservation_id='r-u2ewglfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:41:04Z,user_data=None,user_id='d819e3f51368413c99691d1b45bbcfb1',uuid=1be3ec86-a922-4c20-94da-d2bbdc70dcd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converting VIF {"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5384bf0b-7657-4d2f-b395-c76db88f5f6f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5384bf0b-76') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG os_vif [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5384bf0b-7657-4d2f-b395-c76db88f5f6f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5384bf0b-76') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5384bf0b-76, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5384bf0b-76, col_values=(('external_ids', {'iface-id': '5384bf0b-7657-4d2f-b395-c76db88f5f6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:b5:bc', 'vm-uuid': '1be3ec86-a922-4c20-94da-d2bbdc70dcd6'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:06 user nova-compute[82617]: INFO os_vif [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5384bf0b-7657-4d2f-b395-c76db88f5f6f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5384bf0b-76')
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:41:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] No VIF found with MAC fa:16:3e:04:b5:bc, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:41:07 user nova-compute[82617]: DEBUG nova.network.neutron [req-2f71e2a3-2de1-4543-99bc-7458422ef362 req-a131e604-6415-4e60-aaf6-8b8b0fe5311f service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updated VIF entry in instance network info cache for port 5384bf0b-7657-4d2f-b395-c76db88f5f6f. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:41:07 user nova-compute[82617]: DEBUG nova.network.neutron [req-2f71e2a3-2de1-4543-99bc-7458422ef362 req-a131e604-6415-4e60-aaf6-8b8b0fe5311f service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updating instance_info_cache with network_info: [{"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:41:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2f71e2a3-2de1-4543-99bc-7458422ef362 req-a131e604-6415-4e60-aaf6-8b8b0fe5311f service nova] Releasing lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-6bd2f798-f2ea-405c-b06f-813400fa0425 req-d298cdc3-f08d-4044-926b-61df0d4af9e4 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received event network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd2f798-f2ea-405c-b06f-813400fa0425 req-d298cdc3-f08d-4044-926b-61df0d4af9e4 service nova] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd2f798-f2ea-405c-b06f-813400fa0425 req-d298cdc3-f08d-4044-926b-61df0d4af9e4 service nova] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-6bd2f798-f2ea-405c-b06f-813400fa0425 req-d298cdc3-f08d-4044-926b-61df0d4af9e4 service nova] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-6bd2f798-f2ea-405c-b06f-813400fa0425 req-d298cdc3-f08d-4044-926b-61df0d4af9e4 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] No waiting events found dispatching network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:41:08 user nova-compute[82617]: WARNING nova.compute.manager [req-6bd2f798-f2ea-405c-b06f-813400fa0425 req-d298cdc3-f08d-4044-926b-61df0d4af9e4 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received unexpected event network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f for instance with vm_state building and task_state spawning.
Apr 17 15:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746070.2607148, 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:41:10 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] VM Resumed (Lifecycle Event)
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:41:10 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Instance spawned successfully.
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:10 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746070.2623687, 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:41:10 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] VM Started (Lifecycle Event)
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:41:10 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-9eae32f1-9451-478d-b18e-c199ac365ad4 req-d849d86f-defc-4aa6-9a33-c347603a8e9f service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received event network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9eae32f1-9451-478d-b18e-c199ac365ad4 req-d849d86f-defc-4aa6-9a33-c347603a8e9f service nova] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9eae32f1-9451-478d-b18e-c199ac365ad4 req-d849d86f-defc-4aa6-9a33-c347603a8e9f service nova] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9eae32f1-9451-478d-b18e-c199ac365ad4 req-d849d86f-defc-4aa6-9a33-c347603a8e9f service nova] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-9eae32f1-9451-478d-b18e-c199ac365ad4 req-d849d86f-defc-4aa6-9a33-c347603a8e9f service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] No waiting events found dispatching network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:41:10 user nova-compute[82617]: WARNING nova.compute.manager [req-9eae32f1-9451-478d-b18e-c199ac365ad4 req-d849d86f-defc-4aa6-9a33-c347603a8e9f service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received unexpected event network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f for instance with vm_state building and task_state spawning.
Apr 17 15:41:10 user nova-compute[82617]: INFO nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Took 6.28 seconds to spawn the instance on the hypervisor.
Apr 17 15:41:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:10 user nova-compute[82617]: INFO nova.compute.manager [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Took 6.94 seconds to build instance.
Apr 17 15:41:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-7a142a5b-5b7e-4bdd-8674-1fd91f92a8bb tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.029s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:41:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7973MB free_disk=26.297393798828125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:41:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:40 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:41:40 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:41:40 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:41:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:41:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updating instance_info_cache with network_info: [{"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-aa603d40-37aa-47b1-a289-7c7c4f582f94" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:41:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:41:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:50 user nova-compute[82617]: INFO nova.compute.manager [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Rescuing
Apr 17 15:41:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:41:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquired lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:41:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:41:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updating instance_info_cache with network_info: [{"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "7b621a78-0968-4521-80d5-db5fbe4371ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Releasing lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:41:52 user nova-compute[82617]: INFO nova.compute.claims [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Claim successful on node user
Apr 17 15:41:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-0d736c71-089a-480e-a866-fc25861efff2 req-54dc3a4e-8bc6-4461-b49f-6b5d02db159c service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-unplugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0d736c71-089a-480e-a866-fc25861efff2 req-54dc3a4e-8bc6-4461-b49f-6b5d02db159c service nova] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0d736c71-089a-480e-a866-fc25861efff2 req-54dc3a4e-8bc6-4461-b49f-6b5d02db159c service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0d736c71-089a-480e-a866-fc25861efff2 req-54dc3a4e-8bc6-4461-b49f-6b5d02db159c service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.compute.manager [req-0d736c71-089a-480e-a866-fc25861efff2 req-54dc3a4e-8bc6-4461-b49f-6b5d02db159c service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] No waiting events found dispatching network-vif-unplugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:41:52 user nova-compute[82617]: WARNING nova.compute.manager [req-0d736c71-089a-480e-a866-fc25861efff2 req-54dc3a4e-8bc6-4461-b49f-6b5d02db159c service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received unexpected event network-vif-unplugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 for instance with vm_state active and task_state rescuing.
Apr 17 15:41:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:41:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Instance destroyed successfully.
Apr 17 15:41:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:41:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Attempting rescue
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82617) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Instance directory exists: not creating {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 17 15:41:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Creating image(s)
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'trusted_certs' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.policy [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c407d9d494d485c9c95dc3981284fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d1dae0ad7149bbbd160525d64c0c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:41:52 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Creating image(s)
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "/opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "/opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "0e43c5e180df8f4cfa642804eda3b2378b95c592" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "0e43c5e180df8f4cfa642804eda3b2378b95c592" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue" returned: 0 in 0.049s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'migration_context' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Start _get_guest_xml network_info=[{"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "vif_mac": "fa:16:3e:41:09:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:41:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'resources' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592.part --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.objects.instance [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'numa_topology' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:53 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:41:53 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.objects.instance [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'vcpu_model' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1266906511',display_name='tempest-ServerRescueNegativeTestJSON-server-1266906511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1266906511',id=17,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:40:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9324c99bd4d040bdb5a7f1db782b2783',ramdisk_id='',reservation_id='r-5af3f2wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1346397943',owner_user_name='tempest-ServerRescueNegativeTestJSON-1346397943-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:40:09Z,user_data=None,user_id='8e3487d6b32d46beac556617050fd664',uuid=f67fa07e-0d72-4fc4-a96a-9271dd8e340b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "vif_mac": "fa:16:3e:41:09:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converting VIF {"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "vif_mac": "fa:16:3e:41:09:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:09:af,bridge_name='br-int',has_traffic_filtering=True,id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ec3ccd-f3') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.objects.instance [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'pci_devices' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592.part --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.images [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] 0e8abdde-b99b-4137-923c-a5c36654397b was qcow2, converting to raw {{(pid=82617) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592.part /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592.converted {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:41:53 user nova-compute[82617]:   <uuid>f67fa07e-0d72-4fc4-a96a-9271dd8e340b</uuid>
Apr 17 15:41:53 user nova-compute[82617]:   <name>instance-00000011</name>
Apr 17 15:41:53 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:41:53 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:41:53 user nova-compute[82617]:   <metadata>
Apr 17 15:41:53 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:41:53 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:41:53 user nova-compute[82617]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1266906511</nova:name>
Apr 17 15:41:53 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:41:53</nova:creationTime>
Apr 17 15:41:53 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:41:53 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:41:53 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:41:53 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:41:53 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:41:53 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:41:53 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:41:53 user nova-compute[82617]:       <nova:owner>
Apr 17 15:41:53 user nova-compute[82617]:         <nova:user uuid="8e3487d6b32d46beac556617050fd664">tempest-ServerRescueNegativeTestJSON-1346397943-project-member</nova:user>
Apr 17 15:41:53 user nova-compute[82617]:         <nova:project uuid="9324c99bd4d040bdb5a7f1db782b2783">tempest-ServerRescueNegativeTestJSON-1346397943</nova:project>
Apr 17 15:41:53 user nova-compute[82617]:       </nova:owner>
Apr 17 15:41:53 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:41:53 user nova-compute[82617]:       <nova:ports>
Apr 17 15:41:53 user nova-compute[82617]:         <nova:port uuid="34ec3ccd-f3eb-4481-85c5-90b55f4c2c67">
Apr 17 15:41:53 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 17 15:41:53 user nova-compute[82617]:         </nova:port>
Apr 17 15:41:53 user nova-compute[82617]:       </nova:ports>
Apr 17 15:41:53 user nova-compute[82617]:     </nova:instance>
Apr 17 15:41:53 user nova-compute[82617]:   </metadata>
Apr 17 15:41:53 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:41:53 user nova-compute[82617]:     <system>
Apr 17 15:41:53 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:41:53 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:41:53 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:41:53 user nova-compute[82617]:       <entry name="serial">f67fa07e-0d72-4fc4-a96a-9271dd8e340b</entry>
Apr 17 15:41:53 user nova-compute[82617]:       <entry name="uuid">f67fa07e-0d72-4fc4-a96a-9271dd8e340b</entry>
Apr 17 15:41:53 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:41:53 user nova-compute[82617]:     </system>
Apr 17 15:41:53 user nova-compute[82617]:   </sysinfo>
Apr 17 15:41:53 user nova-compute[82617]:   <os>
Apr 17 15:41:53 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:41:53 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:41:53 user nova-compute[82617]:   </os>
Apr 17 15:41:53 user nova-compute[82617]:   <features>
Apr 17 15:41:53 user nova-compute[82617]:     <acpi/>
Apr 17 15:41:53 user nova-compute[82617]:     <apic/>
Apr 17 15:41:53 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:41:53 user nova-compute[82617]:   </features>
Apr 17 15:41:53 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:41:53 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:41:53 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:41:53 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:41:53 user nova-compute[82617]:   </clock>
Apr 17 15:41:53 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:41:53 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:41:53 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:41:53 user nova-compute[82617]:   </cpu>
Apr 17 15:41:53 user nova-compute[82617]:   <devices>
Apr 17 15:41:53 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:41:53 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:41:53 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue"/>
Apr 17 15:41:53 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:41:53 user nova-compute[82617]:     </disk>
Apr 17 15:41:53 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:41:53 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:41:53 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk"/>
Apr 17 15:41:53 user nova-compute[82617]:       <target dev="vdb" bus="virtio"/>
Apr 17 15:41:53 user nova-compute[82617]:     </disk>
Apr 17 15:41:53 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:41:53 user nova-compute[82617]:       <mac address="fa:16:3e:41:09:af"/>
Apr 17 15:41:53 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:41:53 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:41:53 user nova-compute[82617]:       <target dev="tap34ec3ccd-f3"/>
Apr 17 15:41:53 user nova-compute[82617]:     </interface>
Apr 17 15:41:53 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:41:53 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/console.log" append="off"/>
Apr 17 15:41:53 user nova-compute[82617]:     </serial>
Apr 17 15:41:53 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:41:53 user nova-compute[82617]:     <video>
Apr 17 15:41:53 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:41:53 user nova-compute[82617]:     </video>
Apr 17 15:41:53 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:41:53 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:41:53 user nova-compute[82617]:     </rng>
Apr 17 15:41:53 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:41:53 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:41:53 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:41:53 user nova-compute[82617]:     </memballoon>
Apr 17 15:41:53 user nova-compute[82617]:   </devices>
Apr 17 15:41:53 user nova-compute[82617]: </domain>
Apr 17 15:41:53 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:41:53 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Instance destroyed successfully.
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.network.neutron [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Successfully created port: 70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] No VIF found with MAC fa:16:3e:41:09:af, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592.part /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592.converted" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592.converted --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "0e43c5e180df8f4cfa642804eda3b2378b95c592" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.941s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592 --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "0e43c5e180df8f4cfa642804eda3b2378b95c592" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "0e43c5e180df8f4cfa642804eda3b2378b95c592" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592 --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592,backing_fmt=raw /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592,backing_fmt=raw /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk 1073741824" returned: 0 in 0.052s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "0e43c5e180df8f4cfa642804eda3b2378b95c592" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592 --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.neutron [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Successfully updated port: 70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "refresh_cache-7b621a78-0968-4521-80d5-db5fbe4371ff" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquired lock "refresh_cache-7b621a78-0968-4521-80d5-db5fbe4371ff" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.neutron [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-a9f8281c-5aa0-44e2-ad74-31a99867bf96 req-7bff5c89-8a21-4251-bab5-e4d44f56870a service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received event network-changed-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-a9f8281c-5aa0-44e2-ad74-31a99867bf96 req-7bff5c89-8a21-4251-bab5-e4d44f56870a service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Refreshing instance network info cache due to event network-changed-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a9f8281c-5aa0-44e2-ad74-31a99867bf96 req-7bff5c89-8a21-4251-bab5-e4d44f56870a service nova] Acquiring lock "refresh_cache-7b621a78-0968-4521-80d5-db5fbe4371ff" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Cannot resize image /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.objects.instance [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lazy-loading 'migration_context' on Instance uuid 7b621a78-0968-4521-80d5-db5fbe4371ff {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Ensure instance console log exists: /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.neutron [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-3a6b7b2e-a3b5-42bf-b831-25262725ee4d req-b4c46331-1687-4c82-933d-25d3e56160b9 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3a6b7b2e-a3b5-42bf-b831-25262725ee4d req-b4c46331-1687-4c82-933d-25d3e56160b9 service nova] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3a6b7b2e-a3b5-42bf-b831-25262725ee4d req-b4c46331-1687-4c82-933d-25d3e56160b9 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3a6b7b2e-a3b5-42bf-b831-25262725ee4d req-b4c46331-1687-4c82-933d-25d3e56160b9 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-3a6b7b2e-a3b5-42bf-b831-25262725ee4d req-b4c46331-1687-4c82-933d-25d3e56160b9 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] No waiting events found dispatching network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:41:54 user nova-compute[82617]: WARNING nova.compute.manager [req-3a6b7b2e-a3b5-42bf-b831-25262725ee4d req-b4c46331-1687-4c82-933d-25d3e56160b9 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received unexpected event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 for instance with vm_state active and task_state rescuing.
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.neutron [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Updating instance_info_cache with network_info: [{"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Releasing lock "refresh_cache-7b621a78-0968-4521-80d5-db5fbe4371ff" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Instance network_info: |[{"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a9f8281c-5aa0-44e2-ad74-31a99867bf96 req-7bff5c89-8a21-4251-bab5-e4d44f56870a service nova] Acquired lock "refresh_cache-7b621a78-0968-4521-80d5-db5fbe4371ff" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.neutron [req-a9f8281c-5aa0-44e2-ad74-31a99867bf96 req-7bff5c89-8a21-4251-bab5-e4d44f56870a service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Refreshing network info cache for port 70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Start _get_guest_xml network_info=[{"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:41:49Z,direct_url=<?>,disk_format='qcow2',id=0e8abdde-b99b-4137-923c-a5c36654397b,min_disk=0,min_ram=0,name='tempest-scenario-img--471527327',owner='17d1dae0ad7149bbbd160525d64c0c20',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:41:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0e8abdde-b99b-4137-923c-a5c36654397b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:41:54 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:41:54 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:41:49Z,direct_url=<?>,disk_format='qcow2',id=0e8abdde-b99b-4137-923c-a5c36654397b,min_disk=0,min_ram=0,name='tempest-scenario-img--471527327',owner='17d1dae0ad7149bbbd160525d64c0c20',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:41:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1949711014',display_name='tempest-TestMinimumBasicScenario-server-1949711014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1949711014',id=19,image_ref='0e8abdde-b99b-4137-923c-a5c36654397b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzNQ84O5sEMG/t+W+4jwpqyFRhVsnCQS0Sie73st6YJL7HTcLnuUpsqus6e9FakkJy3oyOXVSbR0eAcxRDH2Q3FjYzRbWyqX3XtvyJWCvCnrG5sft2FkwJtyOEB3fcQLg==',key_name='tempest-TestMinimumBasicScenario-1570287199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d1dae0ad7149bbbd160525d64c0c20',ramdisk_id='',reservation_id='r-xhomxbi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0e8abdde-b99b-4137-923c-a5c36654397b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1774469422',owner_user_name='tempest-TestMinimumBasicScenario-1774469422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:41:53Z,user_data=None,user_id='3c407d9d494d485c9c95dc3981284fba',uuid=7b621a78-0968-4521-80d5-db5fbe4371ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converting VIF {"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=70ccc2a3-6a8a-49c6-be0f-29ca1065b14b,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ccc2a3-6a') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.objects.instance [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b621a78-0968-4521-80d5-db5fbe4371ff {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:41:54 user nova-compute[82617]:   <uuid>7b621a78-0968-4521-80d5-db5fbe4371ff</uuid>
Apr 17 15:41:54 user nova-compute[82617]:   <name>instance-00000013</name>
Apr 17 15:41:54 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:41:54 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:41:54 user nova-compute[82617]:   <metadata>
Apr 17 15:41:54 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:41:54 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:41:54 user nova-compute[82617]:       <nova:name>tempest-TestMinimumBasicScenario-server-1949711014</nova:name>
Apr 17 15:41:54 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:41:54</nova:creationTime>
Apr 17 15:41:54 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:41:54 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:41:54 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:41:54 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:41:54 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:41:54 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:41:54 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:41:54 user nova-compute[82617]:       <nova:owner>
Apr 17 15:41:54 user nova-compute[82617]:         <nova:user uuid="3c407d9d494d485c9c95dc3981284fba">tempest-TestMinimumBasicScenario-1774469422-project-member</nova:user>
Apr 17 15:41:54 user nova-compute[82617]:         <nova:project uuid="17d1dae0ad7149bbbd160525d64c0c20">tempest-TestMinimumBasicScenario-1774469422</nova:project>
Apr 17 15:41:54 user nova-compute[82617]:       </nova:owner>
Apr 17 15:41:54 user nova-compute[82617]:       <nova:root type="image" uuid="0e8abdde-b99b-4137-923c-a5c36654397b"/>
Apr 17 15:41:54 user nova-compute[82617]:       <nova:ports>
Apr 17 15:41:54 user nova-compute[82617]:         <nova:port uuid="70ccc2a3-6a8a-49c6-be0f-29ca1065b14b">
Apr 17 15:41:54 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 17 15:41:54 user nova-compute[82617]:         </nova:port>
Apr 17 15:41:54 user nova-compute[82617]:       </nova:ports>
Apr 17 15:41:54 user nova-compute[82617]:     </nova:instance>
Apr 17 15:41:54 user nova-compute[82617]:   </metadata>
Apr 17 15:41:54 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:41:54 user nova-compute[82617]:     <system>
Apr 17 15:41:54 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:41:54 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:41:54 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:41:54 user nova-compute[82617]:       <entry name="serial">7b621a78-0968-4521-80d5-db5fbe4371ff</entry>
Apr 17 15:41:54 user nova-compute[82617]:       <entry name="uuid">7b621a78-0968-4521-80d5-db5fbe4371ff</entry>
Apr 17 15:41:54 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:41:54 user nova-compute[82617]:     </system>
Apr 17 15:41:54 user nova-compute[82617]:   </sysinfo>
Apr 17 15:41:54 user nova-compute[82617]:   <os>
Apr 17 15:41:54 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:41:54 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:41:54 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:41:54 user nova-compute[82617]:   </os>
Apr 17 15:41:54 user nova-compute[82617]:   <features>
Apr 17 15:41:54 user nova-compute[82617]:     <acpi/>
Apr 17 15:41:54 user nova-compute[82617]:     <apic/>
Apr 17 15:41:54 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:41:54 user nova-compute[82617]:   </features>
Apr 17 15:41:54 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:41:54 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:41:54 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:41:54 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:41:54 user nova-compute[82617]:   </clock>
Apr 17 15:41:54 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:41:54 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:41:54 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:41:54 user nova-compute[82617]:   </cpu>
Apr 17 15:41:54 user nova-compute[82617]:   <devices>
Apr 17 15:41:54 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:41:54 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:41:54 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk"/>
Apr 17 15:41:54 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:41:54 user nova-compute[82617]:     </disk>
Apr 17 15:41:54 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:41:54 user nova-compute[82617]:       <mac address="fa:16:3e:40:0c:88"/>
Apr 17 15:41:54 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:41:54 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:41:54 user nova-compute[82617]:       <target dev="tap70ccc2a3-6a"/>
Apr 17 15:41:54 user nova-compute[82617]:     </interface>
Apr 17 15:41:54 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:41:54 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/console.log" append="off"/>
Apr 17 15:41:54 user nova-compute[82617]:     </serial>
Apr 17 15:41:54 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:41:54 user nova-compute[82617]:     <video>
Apr 17 15:41:54 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:41:54 user nova-compute[82617]:     </video>
Apr 17 15:41:54 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:41:54 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:41:54 user nova-compute[82617]:     </rng>
Apr 17 15:41:54 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:41:54 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:41:54 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:41:54 user nova-compute[82617]:     </memballoon>
Apr 17 15:41:54 user nova-compute[82617]:   </devices>
Apr 17 15:41:54 user nova-compute[82617]: </domain>
Apr 17 15:41:54 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1949711014',display_name='tempest-TestMinimumBasicScenario-server-1949711014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1949711014',id=19,image_ref='0e8abdde-b99b-4137-923c-a5c36654397b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzNQ84O5sEMG/t+W+4jwpqyFRhVsnCQS0Sie73st6YJL7HTcLnuUpsqus6e9FakkJy3oyOXVSbR0eAcxRDH2Q3FjYzRbWyqX3XtvyJWCvCnrG5sft2FkwJtyOEB3fcQLg==',key_name='tempest-TestMinimumBasicScenario-1570287199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d1dae0ad7149bbbd160525d64c0c20',ramdisk_id='',reservation_id='r-xhomxbi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0e8abdde-b99b-4137-923c-a5c36654397b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1774469422',owner_user_name='tempest-TestMinimumBasicScenario-1774469422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:41:53Z,user_data=None,user_id='3c407d9d494d485c9c95dc3981284fba',uuid=7b621a78-0968-4521-80d5-db5fbe4371ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converting VIF {"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=70ccc2a3-6a8a-49c6-be0f-29ca1065b14b,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ccc2a3-6a') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG os_vif [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=70ccc2a3-6a8a-49c6-be0f-29ca1065b14b,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ccc2a3-6a') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70ccc2a3-6a, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70ccc2a3-6a, col_values=(('external_ids', {'iface-id': '70ccc2a3-6a8a-49c6-be0f-29ca1065b14b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:0c:88', 'vm-uuid': '7b621a78-0968-4521-80d5-db5fbe4371ff'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:54 user nova-compute[82617]: INFO os_vif [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=70ccc2a3-6a8a-49c6-be0f-29ca1065b14b,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ccc2a3-6a')
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] No VIF found with MAC fa:16:3e:40:0c:88, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:55 user nova-compute[82617]: DEBUG nova.network.neutron [req-a9f8281c-5aa0-44e2-ad74-31a99867bf96 req-7bff5c89-8a21-4251-bab5-e4d44f56870a service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Updated VIF entry in instance network info cache for port 70ccc2a3-6a8a-49c6-be0f-29ca1065b14b. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:41:55 user nova-compute[82617]: DEBUG nova.network.neutron [req-a9f8281c-5aa0-44e2-ad74-31a99867bf96 req-7bff5c89-8a21-4251-bab5-e4d44f56870a service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Updating instance_info_cache with network_info: [{"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:41:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a9f8281c-5aa0-44e2-ad74-31a99867bf96 req-7bff5c89-8a21-4251-bab5-e4d44f56870a service nova] Releasing lock "refresh_cache-7b621a78-0968-4521-80d5-db5fbe4371ff" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] No waiting events found dispatching network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:41:56 user nova-compute[82617]: WARNING nova.compute.manager [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received unexpected event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 for instance with vm_state active and task_state rescuing.
Apr 17 15:41:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] No waiting events found dispatching network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:41:56 user nova-compute[82617]: WARNING nova.compute.manager [req-fcd91d63-6e66-460d-9aff-a3573b72d9ba req-77e6b34c-f369-4aa5-9885-49bba6fb9b10 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received unexpected event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 for instance with vm_state active and task_state rescuing.
Apr 17 15:41:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.host [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Removed pending event for f67fa07e-0d72-4fc4-a96a-9271dd8e340b due to event {{(pid=82617) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746118.150038, f67fa07e-0d72-4fc4-a96a-9271dd8e340b => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] VM Resumed (Lifecycle Event)
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-deacacdc-620f-41ca-b4cb-b33740ac8c4b tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746118.1519268, f67fa07e-0d72-4fc4-a96a-9271dd8e340b => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] VM Started (Lifecycle Event)
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received event network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] Acquiring lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] No waiting events found dispatching network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:41:58 user nova-compute[82617]: WARNING nova.compute.manager [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received unexpected event network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b for instance with vm_state building and task_state spawning.
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received event network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] Acquiring lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] No waiting events found dispatching network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:41:58 user nova-compute[82617]: WARNING nova.compute.manager [req-74b75435-05ca-454c-b130-4fd51fbfe3b3 req-4987e1f3-858d-462a-8b2e-a72b9c26180d service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received unexpected event network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b for instance with vm_state building and task_state spawning.
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746118.6695619, 7b621a78-0968-4521-80d5-db5fbe4371ff => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] VM Resumed (Lifecycle Event)
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Instance spawned successfully.
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746118.6704028, 7b621a78-0968-4521-80d5-db5fbe4371ff => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] VM Started (Lifecycle Event)
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 17 15:41:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:41:58 user nova-compute[82617]: INFO nova.compute.manager [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Took 6.82 seconds to build instance.
Apr 17 15:41:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-0eea8336-a36e-4b88-add6-c630e3a4a61b tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:41:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:41:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:42:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:42:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:42:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:42:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:42:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:22 user nova-compute[82617]: INFO nova.compute.manager [None req-fc34a576-11f9-4489-a079-bf356d1cce2e tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Get console output
Apr 17 15:42:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:41 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:42:41 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=26.200634002685547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 7b621a78-0968-4521-80d5-db5fbe4371ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:42:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:42:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:42:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:42:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:42:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:42:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:42:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updating instance_info_cache with network_info: [{"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:42:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:42:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:42:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:42:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:42:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:42:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:42:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:42:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:42:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:54 user nova-compute[82617]: INFO nova.compute.manager [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] instance snapshotting
Apr 17 15:42:54 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Beginning live snapshot process
Apr 17 15:42:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:42:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json -f qcow2 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json -f qcow2 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe9i1mzk2/83502a0de2854b9292eddb12e4a306a7.delta 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe9i1mzk2/83502a0de2854b9292eddb12e4a306a7.delta 1073741824" returned: 0 in 0.052s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 17 15:42:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:42:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:42:56 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 17 15:42:56 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:42:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe9i1mzk2/83502a0de2854b9292eddb12e4a306a7.delta /opt/stack/data/nova/instances/snapshots/tmpe9i1mzk2/83502a0de2854b9292eddb12e4a306a7 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:42:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe9i1mzk2/83502a0de2854b9292eddb12e4a306a7.delta /opt/stack/data/nova/instances/snapshots/tmpe9i1mzk2/83502a0de2854b9292eddb12e4a306a7" returned: 0 in 0.519s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:42:57 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Snapshot extracted, beginning image upload
Apr 17 15:42:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Snapshot image upload complete
Apr 17 15:42:59 user nova-compute[82617]: INFO nova.compute.manager [None req-e6b2adf2-a79e-40d5-bf7a-7174bf85404b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Took 4.60 seconds to snapshot the instance on the hypervisor.
Apr 17 15:42:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:43:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:43:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:43:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:43:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:43:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:43:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:43:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:43:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:43:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:43:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:43:41 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:43:41 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7875MB free_disk=26.16131591796875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 7b621a78-0968-4521-80d5-db5fbe4371ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:43:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:43:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:43:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:43:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:43:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:43:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:43:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updating instance_info_cache with network_info: [{"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:43:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:43:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:43:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:43:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:43:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:43:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:43:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:43:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:43:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "05e08eea-cc2c-4332-9e97-07cb9b466af6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:44:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "05e08eea-cc2c-4332-9e97-07cb9b466af6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:44:01 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:44:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:44:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:44:01 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:44:01 user nova-compute[82617]: INFO nova.compute.claims [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Claim successful on node user
Apr 17 15:44:02 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:44:02 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:44:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:44:02 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:44:02 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:44:02 user nova-compute[82617]: DEBUG nova.network.neutron [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:44:02 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:44:02 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:44:02 user nova-compute[82617]: DEBUG nova.policy [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd819e3f51368413c99691d1b45bbcfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540826be4baf46dba9617b2fd47821a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:44:02 user nova-compute[82617]: INFO nova.virt.block_device [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Booting with blank volume at /dev/vda
Apr 17 15:44:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Successfully created port: 3a2bff95-bc85-4529-ae63-7610872aa4d5 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Successfully updated port: 3a2bff95-bc85-4529-ae63-7610872aa4d5 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "refresh_cache-05e08eea-cc2c-4332-9e97-07cb9b466af6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquired lock "refresh_cache-05e08eea-cc2c-4332-9e97-07cb9b466af6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-7d8f5352-2587-4f5b-8b92-7ad1c2da10dc req-854d6907-0e09-40ed-963f-5205ffcc5dd6 service nova] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Received event network-changed-3a2bff95-bc85-4529-ae63-7610872aa4d5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG nova.compute.manager [req-7d8f5352-2587-4f5b-8b92-7ad1c2da10dc req-854d6907-0e09-40ed-963f-5205ffcc5dd6 service nova] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Refreshing instance network info cache due to event network-changed-3a2bff95-bc85-4529-ae63-7610872aa4d5. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7d8f5352-2587-4f5b-8b92-7ad1c2da10dc req-854d6907-0e09-40ed-963f-5205ffcc5dd6 service nova] Acquiring lock "refresh_cache-05e08eea-cc2c-4332-9e97-07cb9b466af6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:44:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Updating instance_info_cache with network_info: [{"id": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "address": "fa:16:3e:c8:4b:80", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a2bff95-bc", "ovs_interfaceid": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Releasing lock "refresh_cache-05e08eea-cc2c-4332-9e97-07cb9b466af6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Instance network_info: |[{"id": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "address": "fa:16:3e:c8:4b:80", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a2bff95-bc", "ovs_interfaceid": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7d8f5352-2587-4f5b-8b92-7ad1c2da10dc req-854d6907-0e09-40ed-963f-5205ffcc5dd6 service nova] Acquired lock "refresh_cache-05e08eea-cc2c-4332-9e97-07cb9b466af6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-7d8f5352-2587-4f5b-8b92-7ad1c2da10dc req-854d6907-0e09-40ed-963f-5205ffcc5dd6 service nova] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Refreshing network info cache for port 3a2bff95-bc85-4529-ae63-7610872aa4d5 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-7d8f5352-2587-4f5b-8b92-7ad1c2da10dc req-854d6907-0e09-40ed-963f-5205ffcc5dd6 service nova] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Updated VIF entry in instance network info cache for port 3a2bff95-bc85-4529-ae63-7610872aa4d5. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG nova.network.neutron [req-7d8f5352-2587-4f5b-8b92-7ad1c2da10dc req-854d6907-0e09-40ed-963f-5205ffcc5dd6 service nova] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Updating instance_info_cache with network_info: [{"id": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "address": "fa:16:3e:c8:4b:80", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a2bff95-bc", "ovs_interfaceid": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7d8f5352-2587-4f5b-8b92-7ad1c2da10dc req-854d6907-0e09-40ed-963f-5205ffcc5dd6 service nova] Releasing lock "refresh_cache-05e08eea-cc2c-4332-9e97-07cb9b466af6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:44:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:44:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:44:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:44:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:44:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:44:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:44:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 15:44:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:44:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:44:41 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:44:41 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7958MB free_disk=26.157299041748047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance edb2d74c-f1e0-4954-9ba9-812fc12562a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 7b621a78-0968-4521-80d5-db5fbe4371ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:44:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:44:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:44:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:44:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 15:44:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:44:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:44:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:44:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:44:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:44:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:44:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:44:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:44:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:44:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:44:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:45:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:45:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:45:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:45:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:45:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:45:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:45:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:45:42 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:45:42 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7948MB free_disk=26.145450592041016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa603d40-37aa-47b1-a289-7c7c4f582f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 7b621a78-0968-4521-80d5-db5fbe4371ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 15:45:42 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 15:45:43 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:45:43 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:45:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:45:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:45:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:49 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:45:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:45:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:45:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:45:51 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:45:51 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [{"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:45:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-6aab9803-ab51-47c6-a2a2-739a7a18f5dc" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:45:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:45:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:45:56 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:56 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:45:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:46:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:46:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:46:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:46:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:46:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:46:19 user nova-compute[82617]: INFO nova.compute.manager [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Terminating instance
Apr 17 15:46:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:46:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.compute.manager [req-142d85c5-ed4f-4de8-afc2-59878651d523 req-bf946eab-bbab-4d0e-90de-83f508e20332 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received event network-vif-unplugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-142d85c5-ed4f-4de8-afc2-59878651d523 req-bf946eab-bbab-4d0e-90de-83f508e20332 service nova] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-142d85c5-ed4f-4de8-afc2-59878651d523 req-bf946eab-bbab-4d0e-90de-83f508e20332 service nova] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-142d85c5-ed4f-4de8-afc2-59878651d523 req-bf946eab-bbab-4d0e-90de-83f508e20332 service nova] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.compute.manager [req-142d85c5-ed4f-4de8-afc2-59878651d523 req-bf946eab-bbab-4d0e-90de-83f508e20332 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] No waiting events found dispatching network-vif-unplugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.compute.manager [req-142d85c5-ed4f-4de8-afc2-59878651d523 req-bf946eab-bbab-4d0e-90de-83f508e20332 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received event network-vif-unplugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:46:20 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Instance destroyed successfully.
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.objects.instance [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lazy-loading 'resources' on Instance uuid aa603d40-37aa-47b1-a289-7c7c4f582f94 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1177449394',display_name='tempest-ServersNegativeTestJSON-server-1177449394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1177449394',id=14,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:28:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2dd48f279404859bebcc19bcc272915',ramdisk_id='',reservation_id='r-qd33fwol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1985071109',owner_user_name='tempest-ServersNegativeTestJSON-1985071109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:28:14Z,user_data=None,user_id='b0075b26d6044a50981d29df0d863959',uuid=aa603d40-37aa-47b1-a289-7c7c4f582f94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converting VIF {"id": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "address": "fa:16:3e:77:a1:b2", "network": {"id": "b40d177e-b5cc-4e6d-b989-137ea13bd426", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-636511887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2dd48f279404859bebcc19bcc272915", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a1f65a-ae", "ovs_interfaceid": "18a1f65a-ae66-44df-8047-07b7a6ed3417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:a1:b2,bridge_name='br-int',has_traffic_filtering=True,id=18a1f65a-ae66-44df-8047-07b7a6ed3417,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a1f65a-ae') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG os_vif [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:a1:b2,bridge_name='br-int',has_traffic_filtering=True,id=18a1f65a-ae66-44df-8047-07b7a6ed3417,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a1f65a-ae') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18a1f65a-ae, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:20 user nova-compute[82617]: INFO os_vif [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:a1:b2,bridge_name='br-int',has_traffic_filtering=True,id=18a1f65a-ae66-44df-8047-07b7a6ed3417,network=Network(b40d177e-b5cc-4e6d-b989-137ea13bd426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a1f65a-ae')
Apr 17 15:46:20 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Deleting instance files /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94_del
Apr 17 15:46:20 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Deletion of /opt/stack/data/nova/instances/aa603d40-37aa-47b1-a289-7c7c4f582f94_del complete
Apr 17 15:46:20 user nova-compute[82617]: INFO nova.compute.manager [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 17 15:46:20 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:46:20 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:46:21 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:46:21 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Took 0.45 seconds to deallocate network for instance.
Apr 17 15:46:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:46:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:46:21 user nova-compute[82617]: DEBUG nova.compute.manager [req-d03bb19b-de50-4317-b2d0-50d9eb4afa64 req-d5e60757-8f66-41f4-a318-c80c187063f2 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received event network-vif-deleted-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:46:21 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:46:21 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:46:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:46:21 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Deleted allocations for instance aa603d40-37aa-47b1-a289-7c7c4f582f94
Apr 17 15:46:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-a6e698a1-3a42-4b15-9d98-c198c1497a1b tempest-ServersNegativeTestJSON-1985071109 tempest-ServersNegativeTestJSON-1985071109-project-member] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.836s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:46:22 user nova-compute[82617]: DEBUG nova.compute.manager [req-b62233f3-6689-42d2-b8c3-76b5cef50c95 req-14beb8f3-f862-466a-aca7-2c6572a3f899 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received event network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:46:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b62233f3-6689-42d2-b8c3-76b5cef50c95 req-14beb8f3-f862-466a-aca7-2c6572a3f899 service nova] Acquiring lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:46:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b62233f3-6689-42d2-b8c3-76b5cef50c95 req-14beb8f3-f862-466a-aca7-2c6572a3f899 service nova] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:46:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b62233f3-6689-42d2-b8c3-76b5cef50c95 req-14beb8f3-f862-466a-aca7-2c6572a3f899 service nova] Lock "aa603d40-37aa-47b1-a289-7c7c4f582f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:46:22 user nova-compute[82617]: DEBUG nova.compute.manager [req-b62233f3-6689-42d2-b8c3-76b5cef50c95 req-14beb8f3-f862-466a-aca7-2c6572a3f899 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] No waiting events found dispatching network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:46:22 user nova-compute[82617]: WARNING nova.compute.manager [req-b62233f3-6689-42d2-b8c3-76b5cef50c95 req-14beb8f3-f862-466a-aca7-2c6572a3f899 service nova] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Received unexpected event network-vif-plugged-18a1f65a-ae66-44df-8047-07b7a6ed3417 for instance with vm_state deleted and task_state None.
Apr 17 15:46:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:35 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681746380.4672794, aa603d40-37aa-47b1-a289-7c7c4f582f94 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:46:35 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] VM Stopped (Lifecycle Event)
Apr 17 15:46:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-1d71e17f-dd5c-4bf0-ae79-7a57149c76e2 None None] [instance: aa603d40-37aa-47b1-a289-7c7c4f582f94] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:46:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:46:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:46:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:46:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:46:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:46:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:46:43 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:46:43 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8018MB free_disk=26.161418914794922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 7b621a78-0968-4521-80d5-db5fbe4371ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:46:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:46:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:46:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:46:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:46:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:46:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:46:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Skipping network cache update for instance because it is Building. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:46:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:46:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:46:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:46:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:46:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:47:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:06 user nova-compute[82617]: INFO nova.compute.manager [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Terminating instance
Apr 17 15:47:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG nova.compute.manager [req-7a42521c-5236-47ff-882e-f5feb2e70a0f req-70874ee2-d34c-4268-ac66-ec6d9dad376c service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-unplugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a42521c-5236-47ff-882e-f5feb2e70a0f req-70874ee2-d34c-4268-ac66-ec6d9dad376c service nova] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a42521c-5236-47ff-882e-f5feb2e70a0f req-70874ee2-d34c-4268-ac66-ec6d9dad376c service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7a42521c-5236-47ff-882e-f5feb2e70a0f req-70874ee2-d34c-4268-ac66-ec6d9dad376c service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG nova.compute.manager [req-7a42521c-5236-47ff-882e-f5feb2e70a0f req-70874ee2-d34c-4268-ac66-ec6d9dad376c service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] No waiting events found dispatching network-vif-unplugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:47:06 user nova-compute[82617]: DEBUG nova.compute.manager [req-7a42521c-5236-47ff-882e-f5feb2e70a0f req-70874ee2-d34c-4268-ac66-ec6d9dad376c service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-unplugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:07 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Instance destroyed successfully.
Apr 17 15:47:07 user nova-compute[82617]: DEBUG nova.objects.instance [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'resources' on Instance uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T15:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-474197410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-474197410',id=4,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaV5vFW5tSygMV/NjPz/shhbcvvyXgIAkaTiBn6tH7J/Mye3Ceh6X2NAQjgM8DqKIlKuMD3s9S4hv0vkh4ho64Mh7ytYIRT4djMpVqyPPj6yRhbanlyE17Pj7gUlgQXBA==',key_name='tempest-keypair-1690039047',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:28:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-qleldwb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=6aab9803-ab51-47c6-a2a2-739a7a18f5dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "address": "fa:16:3e:9a:66:02", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae715f2-40", "ovs_interfaceid": "3ae715f2-409f-4855-94cc-3bbb6cbf1b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_vif [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ae715f2-40, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:07 user nova-compute[82617]: INFO os_vif [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:02,bridge_name='br-int',has_traffic_filtering=True,id=3ae715f2-409f-4855-94cc-3bbb6cbf1b41,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae715f2-40')
Apr 17 15:47:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajgFQvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 15:47:07 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca49a42-dbc9-44d1-b5d8-2b3fef43080d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 15:47:07 user nova-compute[82617]: No targets found.
Apr 17 15:47:07 user nova-compute[82617]: iSNS:
Apr 17 15:47:07 user nova-compute[82617]: No targets found.
Apr 17 15:47:07 user nova-compute[82617]: STATIC:
Apr 17 15:47:07 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9
Apr 17 15:47:07 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:47:07 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:47:07 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214
Apr 17 15:47:07 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:47:07 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:47:07 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911
Apr 17 15:47:07 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 15:47:07 user nova-compute[82617]:                 Iface Name: default
Apr 17 15:47:07 user nova-compute[82617]: FIRMWARE:
Apr 17 15:47:07 user nova-compute[82617]: No targets found.
Apr 17 15:47:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 15:47:07 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 15:47:07 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4ee486-24f5-4933-a2b4-e9392a1d7841]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a7364-b70f-428e-ba86-69fb9be57354]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:47:07 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:47:07 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 15:47:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 15:47:07 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 15:47:07 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 15:47:07 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64b48f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214'): ({'sdd'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Removing single pathed devices sdd {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b24825-cdc8-432b-b602-9f1ae65c9953]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 1 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69c0b29-2027-4a9f-8e4b-c15f02c868e4]: (4, ('fail\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flushing IO for device /dev/sdd {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 1 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdd' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:07 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 20 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 15:47:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-3ad826a7-48ca-479a-ad87-524ec03cfafd req-4358c95b-327b-4be3-8d27-d69b60b5ee53 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:47:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3ad826a7-48ca-479a-ad87-524ec03cfafd req-4358c95b-327b-4be3-8d27-d69b60b5ee53 service nova] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3ad826a7-48ca-479a-ad87-524ec03cfafd req-4358c95b-327b-4be3-8d27-d69b60b5ee53 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3ad826a7-48ca-479a-ad87-524ec03cfafd req-4358c95b-327b-4be3-8d27-d69b60b5ee53 service nova] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-3ad826a7-48ca-479a-ad87-524ec03cfafd req-4358c95b-327b-4be3-8d27-d69b60b5ee53 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] No waiting events found dispatching network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:47:08 user nova-compute[82617]: WARNING nova.compute.manager [req-3ad826a7-48ca-479a-ad87-524ec03cfafd req-4358c95b-327b-4be3-8d27-d69b60b5ee53 service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received unexpected event network-vif-plugged-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 for instance with vm_state active and task_state deleting.
Apr 17 15:47:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:22 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681746427.2521765, 6aab9803-ab51-47c6-a2a2-739a7a18f5dc => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:47:22 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] VM Stopped (Lifecycle Event)
Apr 17 15:47:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8b456996-5ab9-47f5-951d-035b251c997a None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:47:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8b456996-5ab9-47f5-951d-035b251c997a None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:47:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:22 user nova-compute[82617]: INFO nova.compute.manager [None req-8b456996-5ab9-47f5-951d-035b251c997a None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "f4954e16-49b5-4815-9ffb-a45511525c20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "f4954e16-49b5-4815-9ffb-a45511525c20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:47:24 user nova-compute[82617]: INFO nova.compute.claims [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Claim successful on node user
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.network.neutron [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:47:24 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.policy [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fdc7c80b4654692a52c8a4c4149324f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8586cc10142d4743874f43cdb0f37aba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:47:24 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Creating image(s)
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "/opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "/opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk 1073741824" returned: 0 in 0.057s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG nova.network.neutron [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Successfully created port: dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Cannot resize image /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG nova.objects.instance [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'migration_context' on Instance uuid f4954e16-49b5-4815-9ffb-a45511525c20 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Ensure instance console log exists: /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.neutron [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Successfully updated port: dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquired lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.neutron [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-08427d7d-e099-4142-bf0d-0059ff7941b9 req-91213d0c-b2f7-4883-9d24-ee7036ca1025 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received event network-changed-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.compute.manager [req-08427d7d-e099-4142-bf0d-0059ff7941b9 req-91213d0c-b2f7-4883-9d24-ee7036ca1025 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Refreshing instance network info cache due to event network-changed-dfd71496-a7b0-49a5-8b99-9c97cfb696ab. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-08427d7d-e099-4142-bf0d-0059ff7941b9 req-91213d0c-b2f7-4883-9d24-ee7036ca1025 service nova] Acquiring lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.neutron [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.neutron [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Updating instance_info_cache with network_info: [{"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Releasing lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Instance network_info: |[{"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-08427d7d-e099-4142-bf0d-0059ff7941b9 req-91213d0c-b2f7-4883-9d24-ee7036ca1025 service nova] Acquired lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.neutron [req-08427d7d-e099-4142-bf0d-0059ff7941b9 req-91213d0c-b2f7-4883-9d24-ee7036ca1025 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Refreshing network info cache for port dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Start _get_guest_xml network_info=[{"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:47:26 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:47:26 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1990565062',display_name='tempest-AttachVolumeNegativeTest-server-1990565062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1990565062',id=21,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5gLK3grZpOEk7iRtZNyBbbgxeHxgeVFh3vqpodjpnDKVqHd9qWhJCehEyA9oIDahe6o4qzdKUQyek+WAyKc7QO6+B72QibBjSyywyoAk3l4LHEgu0UsHrZOblxrkuNAg==',key_name='tempest-keypair-300961136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-7jk3wri5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:47:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=f4954e16-49b5-4815-9ffb-a45511525c20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:46:a6,bridge_name='br-int',has_traffic_filtering=True,id=dfd71496-a7b0-49a5-8b99-9c97cfb696ab,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd71496-a7') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.objects.instance [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'pci_devices' on Instance uuid f4954e16-49b5-4815-9ffb-a45511525c20 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:47:26 user nova-compute[82617]:   <uuid>f4954e16-49b5-4815-9ffb-a45511525c20</uuid>
Apr 17 15:47:26 user nova-compute[82617]:   <name>instance-00000015</name>
Apr 17 15:47:26 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:47:26 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:47:26 user nova-compute[82617]:   <metadata>
Apr 17 15:47:26 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:47:26 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:47:26 user nova-compute[82617]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1990565062</nova:name>
Apr 17 15:47:26 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:47:26</nova:creationTime>
Apr 17 15:47:26 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:47:26 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:47:26 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:47:26 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:47:26 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:47:26 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:47:26 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:47:26 user nova-compute[82617]:       <nova:owner>
Apr 17 15:47:26 user nova-compute[82617]:         <nova:user uuid="9fdc7c80b4654692a52c8a4c4149324f">tempest-AttachVolumeNegativeTest-331389537-project-member</nova:user>
Apr 17 15:47:26 user nova-compute[82617]:         <nova:project uuid="8586cc10142d4743874f43cdb0f37aba">tempest-AttachVolumeNegativeTest-331389537</nova:project>
Apr 17 15:47:26 user nova-compute[82617]:       </nova:owner>
Apr 17 15:47:26 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:47:26 user nova-compute[82617]:       <nova:ports>
Apr 17 15:47:26 user nova-compute[82617]:         <nova:port uuid="dfd71496-a7b0-49a5-8b99-9c97cfb696ab">
Apr 17 15:47:26 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 17 15:47:26 user nova-compute[82617]:         </nova:port>
Apr 17 15:47:26 user nova-compute[82617]:       </nova:ports>
Apr 17 15:47:26 user nova-compute[82617]:     </nova:instance>
Apr 17 15:47:26 user nova-compute[82617]:   </metadata>
Apr 17 15:47:26 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:47:26 user nova-compute[82617]:     <system>
Apr 17 15:47:26 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:47:26 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:47:26 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:47:26 user nova-compute[82617]:       <entry name="serial">f4954e16-49b5-4815-9ffb-a45511525c20</entry>
Apr 17 15:47:26 user nova-compute[82617]:       <entry name="uuid">f4954e16-49b5-4815-9ffb-a45511525c20</entry>
Apr 17 15:47:26 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:47:26 user nova-compute[82617]:     </system>
Apr 17 15:47:26 user nova-compute[82617]:   </sysinfo>
Apr 17 15:47:26 user nova-compute[82617]:   <os>
Apr 17 15:47:26 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:47:26 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:47:26 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:47:26 user nova-compute[82617]:   </os>
Apr 17 15:47:26 user nova-compute[82617]:   <features>
Apr 17 15:47:26 user nova-compute[82617]:     <acpi/>
Apr 17 15:47:26 user nova-compute[82617]:     <apic/>
Apr 17 15:47:26 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:47:26 user nova-compute[82617]:   </features>
Apr 17 15:47:26 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:47:26 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:47:26 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:47:26 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:47:26 user nova-compute[82617]:   </clock>
Apr 17 15:47:26 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:47:26 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:47:26 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:47:26 user nova-compute[82617]:   </cpu>
Apr 17 15:47:26 user nova-compute[82617]:   <devices>
Apr 17 15:47:26 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:47:26 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:47:26 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk"/>
Apr 17 15:47:26 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:47:26 user nova-compute[82617]:     </disk>
Apr 17 15:47:26 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:47:26 user nova-compute[82617]:       <mac address="fa:16:3e:49:46:a6"/>
Apr 17 15:47:26 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:47:26 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:47:26 user nova-compute[82617]:       <target dev="tapdfd71496-a7"/>
Apr 17 15:47:26 user nova-compute[82617]:     </interface>
Apr 17 15:47:26 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:47:26 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/console.log" append="off"/>
Apr 17 15:47:26 user nova-compute[82617]:     </serial>
Apr 17 15:47:26 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:47:26 user nova-compute[82617]:     <video>
Apr 17 15:47:26 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:47:26 user nova-compute[82617]:     </video>
Apr 17 15:47:26 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:47:26 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:47:26 user nova-compute[82617]:     </rng>
Apr 17 15:47:26 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:47:26 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:47:26 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:47:26 user nova-compute[82617]:     </memballoon>
Apr 17 15:47:26 user nova-compute[82617]:   </devices>
Apr 17 15:47:26 user nova-compute[82617]: </domain>
Apr 17 15:47:26 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1990565062',display_name='tempest-AttachVolumeNegativeTest-server-1990565062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1990565062',id=21,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5gLK3grZpOEk7iRtZNyBbbgxeHxgeVFh3vqpodjpnDKVqHd9qWhJCehEyA9oIDahe6o4qzdKUQyek+WAyKc7QO6+B72QibBjSyywyoAk3l4LHEgu0UsHrZOblxrkuNAg==',key_name='tempest-keypair-300961136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-7jk3wri5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:47:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=f4954e16-49b5-4815-9ffb-a45511525c20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:46:a6,bridge_name='br-int',has_traffic_filtering=True,id=dfd71496-a7b0-49a5-8b99-9c97cfb696ab,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd71496-a7') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG os_vif [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:46:a6,bridge_name='br-int',has_traffic_filtering=True,id=dfd71496-a7b0-49a5-8b99-9c97cfb696ab,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd71496-a7') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfd71496-a7, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfd71496-a7, col_values=(('external_ids', {'iface-id': 'dfd71496-a7b0-49a5-8b99-9c97cfb696ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:46:a6', 'vm-uuid': 'f4954e16-49b5-4815-9ffb-a45511525c20'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:26 user nova-compute[82617]: INFO os_vif [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:46:a6,bridge_name='br-int',has_traffic_filtering=True,id=dfd71496-a7b0-49a5-8b99-9c97cfb696ab,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd71496-a7')
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] No VIF found with MAC fa:16:3e:49:46:a6, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.neutron [req-08427d7d-e099-4142-bf0d-0059ff7941b9 req-91213d0c-b2f7-4883-9d24-ee7036ca1025 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Updated VIF entry in instance network info cache for port dfd71496-a7b0-49a5-8b99-9c97cfb696ab. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG nova.network.neutron [req-08427d7d-e099-4142-bf0d-0059ff7941b9 req-91213d0c-b2f7-4883-9d24-ee7036ca1025 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Updating instance_info_cache with network_info: [{"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:47:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-08427d7d-e099-4142-bf0d-0059ff7941b9 req-91213d0c-b2f7-4883-9d24-ee7036ca1025 service nova] Releasing lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:47:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 1 in 20.034s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdd' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 15:47:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:27 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 40 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 15:47:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-be7ec167-8f66-4b1b-b851-dd39102cb4a7 req-bd646506-56a7-4378-9de6-907f2ea78614 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received event network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-be7ec167-8f66-4b1b-b851-dd39102cb4a7 req-bd646506-56a7-4378-9de6-907f2ea78614 service nova] Acquiring lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-be7ec167-8f66-4b1b-b851-dd39102cb4a7 req-bd646506-56a7-4378-9de6-907f2ea78614 service nova] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-be7ec167-8f66-4b1b-b851-dd39102cb4a7 req-bd646506-56a7-4378-9de6-907f2ea78614 service nova] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-be7ec167-8f66-4b1b-b851-dd39102cb4a7 req-bd646506-56a7-4378-9de6-907f2ea78614 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] No waiting events found dispatching network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:47:28 user nova-compute[82617]: WARNING nova.compute.manager [req-be7ec167-8f66-4b1b-b851-dd39102cb4a7 req-bd646506-56a7-4378-9de6-907f2ea78614 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received unexpected event network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab for instance with vm_state building and task_state spawning.
Apr 17 15:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746450.2035542, f4954e16-49b5-4815-9ffb-a45511525c20 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:47:30 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] VM Resumed (Lifecycle Event)
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:47:30 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Instance spawned successfully.
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-a13868eb-90a6-4f9d-a000-634ec3b4d337 req-fc40e036-100e-422f-8a20-1d8fd4ff75a6 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received event network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a13868eb-90a6-4f9d-a000-634ec3b4d337 req-fc40e036-100e-422f-8a20-1d8fd4ff75a6 service nova] Acquiring lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a13868eb-90a6-4f9d-a000-634ec3b4d337 req-fc40e036-100e-422f-8a20-1d8fd4ff75a6 service nova] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a13868eb-90a6-4f9d-a000-634ec3b4d337 req-fc40e036-100e-422f-8a20-1d8fd4ff75a6 service nova] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-a13868eb-90a6-4f9d-a000-634ec3b4d337 req-fc40e036-100e-422f-8a20-1d8fd4ff75a6 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] No waiting events found dispatching network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:47:30 user nova-compute[82617]: WARNING nova.compute.manager [req-a13868eb-90a6-4f9d-a000-634ec3b4d337 req-fc40e036-100e-422f-8a20-1d8fd4ff75a6 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received unexpected event network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab for instance with vm_state building and task_state spawning.
Apr 17 15:47:30 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746450.205381, f4954e16-49b5-4815-9ffb-a45511525c20 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:47:30 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] VM Started (Lifecycle Event)
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:47:30 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:47:30 user nova-compute[82617]: INFO nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 17 15:47:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:47:30 user nova-compute[82617]: INFO nova.compute.manager [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Took 6.19 seconds to build instance.
Apr 17 15:47:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-316927e5-5278-4c1f-8756-86fe434bbcc0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "f4954e16-49b5-4815-9ffb-a45511525c20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.296s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:47:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:47:43 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:47:43 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8009MB free_disk=26.148799896240234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 7b621a78-0968-4521-80d5-db5fbe4371ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f4954e16-49b5-4815-9ffb-a45511525c20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:47:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:47:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updating instance_info_cache with network_info: [{"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:47:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:56 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:47:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:47:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:48:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 1 in 40.136s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdd' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 15:48:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b4f82a81-4eb2-4fab-8eed-399ed4a9e8b5]: Unexpected error while running command.
Apr 17 15:48:07 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdd
Apr 17 15:48:07 user nova-compute[82617]: Exit code: 1
Apr 17 15:48:07 user nova-compute[82617]: Stdout: ''
Apr 17 15:48:07 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n' {{(pid=92892) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 17 15:48:07 user nova-compute[82617]: Traceback (most recent call last):
Apr 17 15:48:07 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 17 15:48:07 user nova-compute[82617]:     ret = func(*f_args, **f_kwargs)
Apr 17 15:48:07 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 17 15:48:07 user nova-compute[82617]:     return func(*args, **kwargs)
Apr 17 15:48:07 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 17 15:48:07 user nova-compute[82617]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 17 15:48:07 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 17 15:48:07 user nova-compute[82617]:     return putils.execute(on_execute=on_execute,
Apr 17 15:48:07 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 17 15:48:07 user nova-compute[82617]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 17 15:48:07 user nova-compute[82617]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:48:07 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdd
Apr 17 15:48:07 user nova-compute[82617]: Exit code: 1
Apr 17 15:48:07 user nova-compute[82617]: Stdout: ''
Apr 17 15:48:07 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n'
Apr 17 15:48:07 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f82a81-4eb2-4fab-8eed-399ed4a9e8b5]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('', 'blockdev: cannot open /dev/sdd: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdd', None)) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 15:48:07 user nova-compute[82617]: WARNING os_brick.initiator.linuxscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Failed to flush IO buffers prior to removing device: 1: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:48:07 user nova-compute[82617]: WARNING os_brick.exception [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flushing /dev/sdd failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:48:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.322s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 15:48:07 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] <== disconnect_volume: exception (60323ms) ProcessExecutionError('', 'blockdev: cannot open /dev/sdd: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdd', None) {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:188}}
Apr 17 15:48:07 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Ignoring Volume Error on vol 13bf568b-585c-4556-ab78-e9930ad50214 during delete Unexpected error while running command.
Apr 17 15:48:07 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdd
Apr 17 15:48:07 user nova-compute[82617]: Exit code: 1
Apr 17 15:48:07 user nova-compute[82617]: Stdout: ''
Apr 17 15:48:07 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdd: No such device or address\n': oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 15:48:07 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Deleting instance files /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc_del
Apr 17 15:48:07 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Deletion of /opt/stack/data/nova/instances/6aab9803-ab51-47c6-a2a2-739a7a18f5dc_del complete
Apr 17 15:48:07 user nova-compute[82617]: INFO nova.compute.manager [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Took 61.20 seconds to destroy the instance on the hypervisor.
Apr 17 15:48:07 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:48:07 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:48:07 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:48:08 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:48:08 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Took 1.25 seconds to deallocate network for instance.
Apr 17 15:48:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-b1a38b2e-849a-40a7-aa30-ddc571b9bc41 req-87992014-34d9-49c6-8b09-c2b56facdf4b service nova] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Received event network-vif-deleted-3ae715f2-409f-4855-94cc-3bbb6cbf1b41 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:48:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:48:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:48:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:48:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:48:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:48:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:48:43 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:48:43 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:48:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8004MB free_disk=26.128589630126953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:48:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 7b621a78-0968-4521-80d5-db5fbe4371ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f4954e16-49b5-4815-9ffb-a45511525c20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:48:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:48:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updating instance_info_cache with network_info: [{"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-f67fa07e-0d72-4fc4-a96a-9271dd8e340b" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:48:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:48:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:48:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:49:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:49:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:49:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:49:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:49:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:49:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:49:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-0758cea7-bd9e-47a1-9421-c0e2e7a6ebfa req-241b6984-c8f3-408d-85d4-6df590343ecd service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received event network-changed-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-0758cea7-bd9e-47a1-9421-c0e2e7a6ebfa req-241b6984-c8f3-408d-85d4-6df590343ecd service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Refreshing instance network info cache due to event network-changed-dfd71496-a7b0-49a5-8b99-9c97cfb696ab. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0758cea7-bd9e-47a1-9421-c0e2e7a6ebfa req-241b6984-c8f3-408d-85d4-6df590343ecd service nova] Acquiring lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0758cea7-bd9e-47a1-9421-c0e2e7a6ebfa req-241b6984-c8f3-408d-85d4-6df590343ecd service nova] Acquired lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG nova.network.neutron [req-0758cea7-bd9e-47a1-9421-c0e2e7a6ebfa req-241b6984-c8f3-408d-85d4-6df590343ecd service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Refreshing network info cache for port dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG nova.network.neutron [req-0758cea7-bd9e-47a1-9421-c0e2e7a6ebfa req-241b6984-c8f3-408d-85d4-6df590343ecd service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Updated VIF entry in instance network info cache for port dfd71496-a7b0-49a5-8b99-9c97cfb696ab. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG nova.network.neutron [req-0758cea7-bd9e-47a1-9421-c0e2e7a6ebfa req-241b6984-c8f3-408d-85d4-6df590343ecd service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Updating instance_info_cache with network_info: [{"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:49:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0758cea7-bd9e-47a1-9421-c0e2e7a6ebfa req-241b6984-c8f3-408d-85d4-6df590343ecd service nova] Releasing lock "refresh_cache-f4954e16-49b5-4815-9ffb-a45511525c20" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:49:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:38 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 15:49:38 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:41 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:42 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:49:43 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:49:43 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:49:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7996MB free_disk=26.11648178100586GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:49:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 7b621a78-0968-4521-80d5-db5fbe4371ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f4954e16-49b5-4815-9ffb-a45511525c20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:49:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updating instance_info_cache with network_info: [{"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:49:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:49:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:49:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:49:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:49:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:49:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:49:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 15:50:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:04 user nova-compute[82617]: WARNING nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] While synchronizing instance power states, found 9 instances in the database and 7 instances on the hypervisor.
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 7b621a78-0968-4521-80d5-db5fbe4371ff {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 05e08eea-cc2c-4332-9e97-07cb9b466af6 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid f4954e16-49b5-4815-9ffb-a45511525c20 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 6aab9803-ab51-47c6-a2a2-739a7a18f5dc {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "7b621a78-0968-4521-80d5-db5fbe4371ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "05e08eea-cc2c-4332-9e97-07cb9b466af6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "f4954e16-49b5-4815-9ffb-a45511525c20" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "f4954e16-49b5-4815-9ffb-a45511525c20" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "f4954e16-49b5-4815-9ffb-a45511525c20" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:09 user nova-compute[82617]: ERROR nova.volume.cinder [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Delete attachment failed for attachment 1634a7d0-3313-448e-9888-8de015f268af. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-d9cf97f7-129f-4cb2-9bc2-f51b1339159a) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-d9cf97f7-129f-4cb2-9bc2-f51b1339159a)
Apr 17 15:50:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "7b621a78-0968-4521-80d5-db5fbe4371ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:16 user nova-compute[82617]: INFO nova.compute.manager [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Terminating instance
Apr 17 15:50:16 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-da50786c-e991-4927-a3a6-b2bde867b17a req-3787042c-9a7d-4f8a-9316-26b130b78f69 service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received event network-vif-unplugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-da50786c-e991-4927-a3a6-b2bde867b17a req-3787042c-9a7d-4f8a-9316-26b130b78f69 service nova] Acquiring lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-da50786c-e991-4927-a3a6-b2bde867b17a req-3787042c-9a7d-4f8a-9316-26b130b78f69 service nova] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-da50786c-e991-4927-a3a6-b2bde867b17a req-3787042c-9a7d-4f8a-9316-26b130b78f69 service nova] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-da50786c-e991-4927-a3a6-b2bde867b17a req-3787042c-9a7d-4f8a-9316-26b130b78f69 service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] No waiting events found dispatching network-vif-unplugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-da50786c-e991-4927-a3a6-b2bde867b17a req-3787042c-9a7d-4f8a-9316-26b130b78f69 service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received event network-vif-unplugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:50:17 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Instance destroyed successfully.
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.objects.instance [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lazy-loading 'resources' on Instance uuid 7b621a78-0968-4521-80d5-db5fbe4371ff {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1949711014',display_name='tempest-TestMinimumBasicScenario-server-1949711014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1949711014',id=19,image_ref='0e8abdde-b99b-4137-923c-a5c36654397b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzNQ84O5sEMG/t+W+4jwpqyFRhVsnCQS0Sie73st6YJL7HTcLnuUpsqus6e9FakkJy3oyOXVSbR0eAcxRDH2Q3FjYzRbWyqX3XtvyJWCvCnrG5sft2FkwJtyOEB3fcQLg==',key_name='tempest-TestMinimumBasicScenario-1570287199',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:41:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17d1dae0ad7149bbbd160525d64c0c20',ramdisk_id='',reservation_id='r-xhomxbi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0e8abdde-b99b-4137-923c-a5c36654397b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1774469422',owner_user_name='tempest-TestMinimumBasicScenario-1774469422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:41:59Z,user_data=None,user_id='3c407d9d494d485c9c95dc3981284fba',uuid=7b621a78-0968-4521-80d5-db5fbe4371ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converting VIF {"id": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "address": "fa:16:3e:40:0c:88", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ccc2a3-6a", "ovs_interfaceid": "70ccc2a3-6a8a-49c6-be0f-29ca1065b14b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=70ccc2a3-6a8a-49c6-be0f-29ca1065b14b,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ccc2a3-6a') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG os_vif [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=70ccc2a3-6a8a-49c6-be0f-29ca1065b14b,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ccc2a3-6a') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70ccc2a3-6a, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:17 user nova-compute[82617]: INFO os_vif [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=70ccc2a3-6a8a-49c6-be0f-29ca1065b14b,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ccc2a3-6a')
Apr 17 15:50:17 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Deleting instance files /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff_del
Apr 17 15:50:17 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Deletion of /opt/stack/data/nova/instances/7b621a78-0968-4521-80d5-db5fbe4371ff_del complete
Apr 17 15:50:17 user nova-compute[82617]: INFO nova.compute.manager [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 17 15:50:17 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:50:17 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Took 0.53 seconds to deallocate network for instance.
Apr 17 15:50:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-0900a322-585c-4d7f-9a80-867348ce8fdc req-99840aed-e73b-48bb-94e5-e46fe6136fab service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received event network-vif-deleted-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:50:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:18 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:50:18 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:50:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:18 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Deleted allocations for instance 7b621a78-0968-4521-80d5-db5fbe4371ff
Apr 17 15:50:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4f35a7be-4357-473e-9fe8-1f78ee40010d tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:19 user nova-compute[82617]: DEBUG nova.compute.manager [req-609b130c-fa8d-4cf7-a2ba-877addaf87de req-39e221fa-71c4-4c00-839e-2aecab00db9a service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received event network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:50:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-609b130c-fa8d-4cf7-a2ba-877addaf87de req-39e221fa-71c4-4c00-839e-2aecab00db9a service nova] Acquiring lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-609b130c-fa8d-4cf7-a2ba-877addaf87de req-39e221fa-71c4-4c00-839e-2aecab00db9a service nova] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-609b130c-fa8d-4cf7-a2ba-877addaf87de req-39e221fa-71c4-4c00-839e-2aecab00db9a service nova] Lock "7b621a78-0968-4521-80d5-db5fbe4371ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:19 user nova-compute[82617]: DEBUG nova.compute.manager [req-609b130c-fa8d-4cf7-a2ba-877addaf87de req-39e221fa-71c4-4c00-839e-2aecab00db9a service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] No waiting events found dispatching network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:50:19 user nova-compute[82617]: WARNING nova.compute.manager [req-609b130c-fa8d-4cf7-a2ba-877addaf87de req-39e221fa-71c4-4c00-839e-2aecab00db9a service nova] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Received unexpected event network-vif-plugged-70ccc2a3-6a8a-49c6-be0f-29ca1065b14b for instance with vm_state deleted and task_state None.
Apr 17 15:50:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:32 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681746617.3007326, 7b621a78-0968-4521-80d5-db5fbe4371ff => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:50:32 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] VM Stopped (Lifecycle Event)
Apr 17 15:50:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-21754ef9-fae7-4b3b-aadc-ffcc6be87041 None None] [instance: 7b621a78-0968-4521-80d5-db5fbe4371ff] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:50:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:50:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:50:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:50:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:50:45 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:50:45 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=26.133453369140625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f4954e16-49b5-4815-9ffb-a45511525c20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 15:50:45 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 15:50:46 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:50:46 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:50:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:50:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:56 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:50:57 user nova-compute[82617]: WARNING nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Volume id: 2c9714de-f8ea-4d1d-99f9-beb85126ad91 finished being created but its status is error.
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Instance failed block device setup: nova.exception.VolumeNotCreated: Volume 2c9714de-f8ea-4d1d-99f9-beb85126ad91 did not finish being created even after we waited 414 seconds or 83 attempts. And its status is error.
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Traceback (most recent call last):
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/opt/stack/nova/nova/compute/manager.py", line 2175, in _prep_block_device
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     driver_block_device.attach_block_devices(
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     _log_and_attach(device)
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     bdm.attach(*attach_args, **attach_kwargs)
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/opt/stack/nova/nova/virt/block_device.py", line 848, in attach
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     self.volume_id, self.attachment_id = self._create_volume(
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/opt/stack/nova/nova/virt/block_device.py", line 435, in _create_volume
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     self._call_wait_func(context, wait_func, volume_api, vol['id'])
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/opt/stack/nova/nova/virt/block_device.py", line 785, in _call_wait_func
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     with excutils.save_and_reraise_exception():
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     self.force_reraise()
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     raise self.value
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/opt/stack/nova/nova/virt/block_device.py", line 783, in _call_wait_func
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     wait_func(context, volume_id)
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]   File "/opt/stack/nova/nova/compute/manager.py", line 1792, in _await_block_device_map_created
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6]     raise exception.VolumeNotCreated(volume_id=vol_id,
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] nova.exception.VolumeNotCreated: Volume 2c9714de-f8ea-4d1d-99f9-beb85126ad91 did not finish being created even after we waited 414 seconds or 83 attempts. And its status is error.
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] 
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.compute.claims [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Aborting claim: <nova.compute.claims.Claim object at 0x7fd64e6825f0> {{(pid=82617) abort /opt/stack/nova/nova/compute/claims.py:84}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.326s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Build of instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 aborted: Volume 2c9714de-f8ea-4d1d-99f9-beb85126ad91 did not finish being created even after we waited 414 seconds or 83 attempts. And its status is error. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2636}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.compute.utils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Build of instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 aborted: Volume 2c9714de-f8ea-4d1d-99f9-beb85126ad91 did not finish being created even after we waited 414 seconds or 83 attempts. And its status is error. {{(pid=82617) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Apr 17 15:50:57 user nova-compute[82617]: ERROR nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Build of instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 aborted: Volume 2c9714de-f8ea-4d1d-99f9-beb85126ad91 did not finish being created even after we waited 414 seconds or 83 attempts. And its status is error.: nova.exception.BuildAbortException: Build of instance 05e08eea-cc2c-4332-9e97-07cb9b466af6 aborted: Volume 2c9714de-f8ea-4d1d-99f9-beb85126ad91 did not finish being created even after we waited 414 seconds or 83 attempts. And its status is error.
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Unplugging VIFs for instance {{(pid=82617) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2961}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:44:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1187189530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1187189530',id=20,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540826be4baf46dba9617b2fd47821a3',ramdisk_id='',reservation_id='r-6nna7io7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:44:02Z,user_data=None,user_id='d819e3f51368413c99691d1b45bbcfb1',uuid=05e08eea-cc2c-4332-9e97-07cb9b466af6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "address": "fa:16:3e:c8:4b:80", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a2bff95-bc", "ovs_interfaceid": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converting VIF {"id": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "address": "fa:16:3e:c8:4b:80", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a2bff95-bc", "ovs_interfaceid": "3a2bff95-bc85-4529-ae63-7610872aa4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:4b:80,bridge_name='br-int',has_traffic_filtering=True,id=3a2bff95-bc85-4529-ae63-7610872aa4d5,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a2bff95-bc') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG os_vif [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:4b:80,bridge_name='br-int',has_traffic_filtering=True,id=3a2bff95-bc85-4529-ae63-7610872aa4d5,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a2bff95-bc') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a2bff95-bc, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:50:57 user nova-compute[82617]: INFO os_vif [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:4b:80,bridge_name='br-int',has_traffic_filtering=True,id=3a2bff95-bc85-4529-ae63-7610872aa4d5,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a2bff95-bc')
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Unplugged VIFs for instance {{(pid=82617) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2997}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:50:57 user nova-compute[82617]: DEBUG nova.network.neutron [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:50:58 user nova-compute[82617]: DEBUG nova.network.neutron [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:50:58 user nova-compute[82617]: INFO nova.compute.manager [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] Took 0.85 seconds to deallocate network for instance.
Apr 17 15:50:58 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Deleted allocations for instance 05e08eea-cc2c-4332-9e97-07cb9b466af6
Apr 17 15:50:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-64a49643-ef0f-426a-909b-8f85130cc57b tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "05e08eea-cc2c-4332-9e97-07cb9b466af6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 416.869s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:50:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "05e08eea-cc2c-4332-9e97-07cb9b466af6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 54.060s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:50:58 user nova-compute[82617]: INFO nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 05e08eea-cc2c-4332-9e97-07cb9b466af6] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Apr 17 15:50:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "05e08eea-cc2c-4332-9e97-07cb9b466af6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "a5d93724-6e77-4b84-8402-812538223cb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "a5d93724-6e77-4b84-8402-812538223cb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:51:11 user nova-compute[82617]: INFO nova.compute.claims [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Claim successful on node user
Apr 17 15:51:11 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:51:11 user nova-compute[82617]: DEBUG nova.network.neutron [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:51:11 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:51:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:51:12 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Creating image(s)
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "/opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "/opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "6082e32daf529637a751c82e6b79b6e611bd90dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "6082e32daf529637a751c82e6b79b6e611bd90dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG nova.policy [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c407d9d494d485c9c95dc3981284fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d1dae0ad7149bbbd160525d64c0c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd.part --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd.part --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG nova.virt.images [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] 80c527e1-d48e-4a47-a68b-811d385b7db2 was qcow2, converting to raw {{(pid=82617) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd.part /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd.converted {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd.part /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd.converted" returned: 0 in 0.302s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd.converted --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:12 user nova-compute[82617]: DEBUG nova.network.neutron [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Successfully created port: 26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "6082e32daf529637a751c82e6b79b6e611bd90dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.040s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd --force-share --output=json" returned: 0 in 0.157s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "6082e32daf529637a751c82e6b79b6e611bd90dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "6082e32daf529637a751c82e6b79b6e611bd90dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd --force-share --output=json" returned: 0 in 0.156s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd,backing_fmt=raw /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd,backing_fmt=raw /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk 1073741824" returned: 0 in 0.074s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "6082e32daf529637a751c82e6b79b6e611bd90dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd --force-share --output=json" returned: 0 in 0.153s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Cannot resize image /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.objects.instance [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lazy-loading 'migration_context' on Instance uuid a5d93724-6e77-4b84-8402-812538223cb8 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Ensure instance console log exists: /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Successfully updated port: 26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquired lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-d83142d2-b502-4a2a-a39f-3b36e1ecf803 req-a96a71dd-90a0-428e-80a2-6af59b5544fd service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received event network-changed-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-d83142d2-b502-4a2a-a39f-3b36e1ecf803 req-a96a71dd-90a0-428e-80a2-6af59b5544fd service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Refreshing instance network info cache due to event network-changed-26705b2b-0508-4415-bec0-ca247f594d00. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d83142d2-b502-4a2a-a39f-3b36e1ecf803 req-a96a71dd-90a0-428e-80a2-6af59b5544fd service nova] Acquiring lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:51:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.network.neutron [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Updating instance_info_cache with network_info: [{"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Releasing lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Instance network_info: |[{"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d83142d2-b502-4a2a-a39f-3b36e1ecf803 req-a96a71dd-90a0-428e-80a2-6af59b5544fd service nova] Acquired lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-d83142d2-b502-4a2a-a39f-3b36e1ecf803 req-a96a71dd-90a0-428e-80a2-6af59b5544fd service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Refreshing network info cache for port 26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Start _get_guest_xml network_info=[{"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:51:09Z,direct_url=<?>,disk_format='qcow2',id=80c527e1-d48e-4a47-a68b-811d385b7db2,min_disk=0,min_ram=0,name='tempest-scenario-img--584071108',owner='17d1dae0ad7149bbbd160525d64c0c20',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:51:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '80c527e1-d48e-4a47-a68b-811d385b7db2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:51:14 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:51:14 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:51:09Z,direct_url=<?>,disk_format='qcow2',id=80c527e1-d48e-4a47-a68b-811d385b7db2,min_disk=0,min_ram=0,name='tempest-scenario-img--584071108',owner='17d1dae0ad7149bbbd160525d64c0c20',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:51:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:51:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1535115258',display_name='tempest-TestMinimumBasicScenario-server-1535115258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1535115258',id=22,image_ref='80c527e1-d48e-4a47-a68b-811d385b7db2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBAQHIBaPGb1kijEzJu6HOjYHXu+WJQP8fPmC6jvA7SCQH0c0f+SYm/tjpF0RB5CdQ18IqKShjCStTehJOoThK4X8s1IWwefCquYWDSEaZF0/TZh+S0PXqVjdRETxubzw==',key_name='tempest-TestMinimumBasicScenario-267961014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d1dae0ad7149bbbd160525d64c0c20',ramdisk_id='',reservation_id='r-27bbpirm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80c527e1-d48e-4a47-a68b-811d385b7db2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1774469422',owner_user_name='tempest-TestMinimumBasicScenario-1774469422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:51:12Z,user_data=None,user_id='3c407d9d494d485c9c95dc3981284fba',uuid=a5d93724-6e77-4b84-8402-812538223cb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converting VIF {"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:94:a9,bridge_name='br-int',has_traffic_filtering=True,id=26705b2b-0508-4415-bec0-ca247f594d00,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26705b2b-05') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.objects.instance [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lazy-loading 'pci_devices' on Instance uuid a5d93724-6e77-4b84-8402-812538223cb8 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:51:14 user nova-compute[82617]:   <uuid>a5d93724-6e77-4b84-8402-812538223cb8</uuid>
Apr 17 15:51:14 user nova-compute[82617]:   <name>instance-00000016</name>
Apr 17 15:51:14 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:51:14 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:51:14 user nova-compute[82617]:   <metadata>
Apr 17 15:51:14 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:51:14 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:51:14 user nova-compute[82617]:       <nova:name>tempest-TestMinimumBasicScenario-server-1535115258</nova:name>
Apr 17 15:51:14 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:51:14</nova:creationTime>
Apr 17 15:51:14 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:51:14 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:51:14 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:51:14 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:51:14 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:51:14 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:51:14 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:51:14 user nova-compute[82617]:       <nova:owner>
Apr 17 15:51:14 user nova-compute[82617]:         <nova:user uuid="3c407d9d494d485c9c95dc3981284fba">tempest-TestMinimumBasicScenario-1774469422-project-member</nova:user>
Apr 17 15:51:14 user nova-compute[82617]:         <nova:project uuid="17d1dae0ad7149bbbd160525d64c0c20">tempest-TestMinimumBasicScenario-1774469422</nova:project>
Apr 17 15:51:14 user nova-compute[82617]:       </nova:owner>
Apr 17 15:51:14 user nova-compute[82617]:       <nova:root type="image" uuid="80c527e1-d48e-4a47-a68b-811d385b7db2"/>
Apr 17 15:51:14 user nova-compute[82617]:       <nova:ports>
Apr 17 15:51:14 user nova-compute[82617]:         <nova:port uuid="26705b2b-0508-4415-bec0-ca247f594d00">
Apr 17 15:51:14 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 15:51:14 user nova-compute[82617]:         </nova:port>
Apr 17 15:51:14 user nova-compute[82617]:       </nova:ports>
Apr 17 15:51:14 user nova-compute[82617]:     </nova:instance>
Apr 17 15:51:14 user nova-compute[82617]:   </metadata>
Apr 17 15:51:14 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:51:14 user nova-compute[82617]:     <system>
Apr 17 15:51:14 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:51:14 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:51:14 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:51:14 user nova-compute[82617]:       <entry name="serial">a5d93724-6e77-4b84-8402-812538223cb8</entry>
Apr 17 15:51:14 user nova-compute[82617]:       <entry name="uuid">a5d93724-6e77-4b84-8402-812538223cb8</entry>
Apr 17 15:51:14 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:51:14 user nova-compute[82617]:     </system>
Apr 17 15:51:14 user nova-compute[82617]:   </sysinfo>
Apr 17 15:51:14 user nova-compute[82617]:   <os>
Apr 17 15:51:14 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:51:14 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:51:14 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:51:14 user nova-compute[82617]:   </os>
Apr 17 15:51:14 user nova-compute[82617]:   <features>
Apr 17 15:51:14 user nova-compute[82617]:     <acpi/>
Apr 17 15:51:14 user nova-compute[82617]:     <apic/>
Apr 17 15:51:14 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:51:14 user nova-compute[82617]:   </features>
Apr 17 15:51:14 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:51:14 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:51:14 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:51:14 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:51:14 user nova-compute[82617]:   </clock>
Apr 17 15:51:14 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:51:14 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:51:14 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:51:14 user nova-compute[82617]:   </cpu>
Apr 17 15:51:14 user nova-compute[82617]:   <devices>
Apr 17 15:51:14 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:51:14 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:51:14 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk"/>
Apr 17 15:51:14 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:51:14 user nova-compute[82617]:     </disk>
Apr 17 15:51:14 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:51:14 user nova-compute[82617]:       <mac address="fa:16:3e:d6:94:a9"/>
Apr 17 15:51:14 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:51:14 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:51:14 user nova-compute[82617]:       <target dev="tap26705b2b-05"/>
Apr 17 15:51:14 user nova-compute[82617]:     </interface>
Apr 17 15:51:14 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:51:14 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/console.log" append="off"/>
Apr 17 15:51:14 user nova-compute[82617]:     </serial>
Apr 17 15:51:14 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:51:14 user nova-compute[82617]:     <video>
Apr 17 15:51:14 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:51:14 user nova-compute[82617]:     </video>
Apr 17 15:51:14 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:51:14 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:51:14 user nova-compute[82617]:     </rng>
Apr 17 15:51:14 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:51:14 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:51:14 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:51:14 user nova-compute[82617]:     </memballoon>
Apr 17 15:51:14 user nova-compute[82617]:   </devices>
Apr 17 15:51:14 user nova-compute[82617]: </domain>
Apr 17 15:51:14 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:51:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1535115258',display_name='tempest-TestMinimumBasicScenario-server-1535115258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1535115258',id=22,image_ref='80c527e1-d48e-4a47-a68b-811d385b7db2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBAQHIBaPGb1kijEzJu6HOjYHXu+WJQP8fPmC6jvA7SCQH0c0f+SYm/tjpF0RB5CdQ18IqKShjCStTehJOoThK4X8s1IWwefCquYWDSEaZF0/TZh+S0PXqVjdRETxubzw==',key_name='tempest-TestMinimumBasicScenario-267961014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d1dae0ad7149bbbd160525d64c0c20',ramdisk_id='',reservation_id='r-27bbpirm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80c527e1-d48e-4a47-a68b-811d385b7db2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1774469422',owner_user_name='tempest-TestMinimumBasicScenario-1774469422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:51:12Z,user_data=None,user_id='3c407d9d494d485c9c95dc3981284fba',uuid=a5d93724-6e77-4b84-8402-812538223cb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converting VIF {"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:94:a9,bridge_name='br-int',has_traffic_filtering=True,id=26705b2b-0508-4415-bec0-ca247f594d00,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26705b2b-05') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG os_vif [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:94:a9,bridge_name='br-int',has_traffic_filtering=True,id=26705b2b-0508-4415-bec0-ca247f594d00,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26705b2b-05') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26705b2b-05, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26705b2b-05, col_values=(('external_ids', {'iface-id': '26705b2b-0508-4415-bec0-ca247f594d00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:94:a9', 'vm-uuid': 'a5d93724-6e77-4b84-8402-812538223cb8'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:14 user nova-compute[82617]: INFO os_vif [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:94:a9,bridge_name='br-int',has_traffic_filtering=True,id=26705b2b-0508-4415-bec0-ca247f594d00,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26705b2b-05')
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] No VIF found with MAC fa:16:3e:d6:94:a9, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-d83142d2-b502-4a2a-a39f-3b36e1ecf803 req-a96a71dd-90a0-428e-80a2-6af59b5544fd service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Updated VIF entry in instance network info cache for port 26705b2b-0508-4415-bec0-ca247f594d00. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-d83142d2-b502-4a2a-a39f-3b36e1ecf803 req-a96a71dd-90a0-428e-80a2-6af59b5544fd service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Updating instance_info_cache with network_info: [{"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:51:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-d83142d2-b502-4a2a-a39f-3b36e1ecf803 req-a96a71dd-90a0-428e-80a2-6af59b5544fd service nova] Releasing lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-9c2701e2-a566-4c6d-a96d-60dd252e2833 req-96953cf7-b472-4a35-96f0-874998be95a8 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received event network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c2701e2-a566-4c6d-a96d-60dd252e2833 req-96953cf7-b472-4a35-96f0-874998be95a8 service nova] Acquiring lock "a5d93724-6e77-4b84-8402-812538223cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c2701e2-a566-4c6d-a96d-60dd252e2833 req-96953cf7-b472-4a35-96f0-874998be95a8 service nova] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9c2701e2-a566-4c6d-a96d-60dd252e2833 req-96953cf7-b472-4a35-96f0-874998be95a8 service nova] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-9c2701e2-a566-4c6d-a96d-60dd252e2833 req-96953cf7-b472-4a35-96f0-874998be95a8 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] No waiting events found dispatching network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:51:15 user nova-compute[82617]: WARNING nova.compute.manager [req-9c2701e2-a566-4c6d-a96d-60dd252e2833 req-96953cf7-b472-4a35-96f0-874998be95a8 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received unexpected event network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 for instance with vm_state building and task_state spawning.
Apr 17 15:51:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746677.828978, a5d93724-6e77-4b84-8402-812538223cb8 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:51:17 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] VM Resumed (Lifecycle Event)
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:51:17 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Instance spawned successfully.
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:17 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746677.8310559, a5d93724-6e77-4b84-8402-812538223cb8 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:51:17 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] VM Started (Lifecycle Event)
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:51:17 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:51:17 user nova-compute[82617]: INFO nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Took 5.93 seconds to spawn the instance on the hypervisor.
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-06fda853-41bc-48d6-b81f-3faa7af6cda6 req-f594de1a-06b2-4827-8132-d5214e9a370c service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received event network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-06fda853-41bc-48d6-b81f-3faa7af6cda6 req-f594de1a-06b2-4827-8132-d5214e9a370c service nova] Acquiring lock "a5d93724-6e77-4b84-8402-812538223cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-06fda853-41bc-48d6-b81f-3faa7af6cda6 req-f594de1a-06b2-4827-8132-d5214e9a370c service nova] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-06fda853-41bc-48d6-b81f-3faa7af6cda6 req-f594de1a-06b2-4827-8132-d5214e9a370c service nova] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-06fda853-41bc-48d6-b81f-3faa7af6cda6 req-f594de1a-06b2-4827-8132-d5214e9a370c service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] No waiting events found dispatching network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:51:17 user nova-compute[82617]: WARNING nova.compute.manager [req-06fda853-41bc-48d6-b81f-3faa7af6cda6 req-f594de1a-06b2-4827-8132-d5214e9a370c service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received unexpected event network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 for instance with vm_state building and task_state spawning.
Apr 17 15:51:18 user nova-compute[82617]: INFO nova.compute.manager [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Took 6.60 seconds to build instance.
Apr 17 15:51:18 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-98029de2-ef41-40c5-bba9-0e8a6d72feed tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "a5d93724-6e77-4b84-8402-812538223cb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.710s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:51:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:51:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:36 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:51:36 user nova-compute[82617]: INFO nova.compute.claims [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Claim successful on node user
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.network.neutron [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:51:37 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.policy [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd819e3f51368413c99691d1b45bbcfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540826be4baf46dba9617b2fd47821a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:51:37 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Creating image(s)
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "/opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "/opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "/opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk 1073741824" returned: 0 in 0.074s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:37 user nova-compute[82617]: DEBUG nova.network.neutron [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Successfully created port: d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Cannot resize image /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.objects.instance [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lazy-loading 'migration_context' on Instance uuid 188b31f8-8f5e-41b7-86c5-f0668ea52be7 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Ensure instance console log exists: /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.network.neutron [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Successfully updated port: d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquired lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.network.neutron [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.network.neutron [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.compute.manager [req-fced4ab4-84a9-4b5b-b442-74c49eedcec1 req-9fa99503-9c31-4597-8395-b0a6e07ab86a service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received event network-changed-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.compute.manager [req-fced4ab4-84a9-4b5b-b442-74c49eedcec1 req-9fa99503-9c31-4597-8395-b0a6e07ab86a service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Refreshing instance network info cache due to event network-changed-d0d89b4a-1f15-4597-921f-546dc4992df8. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fced4ab4-84a9-4b5b-b442-74c49eedcec1 req-9fa99503-9c31-4597-8395-b0a6e07ab86a service nova] Acquiring lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:51:38 user nova-compute[82617]: DEBUG nova.network.neutron [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Updating instance_info_cache with network_info: [{"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Releasing lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Instance network_info: |[{"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fced4ab4-84a9-4b5b-b442-74c49eedcec1 req-9fa99503-9c31-4597-8395-b0a6e07ab86a service nova] Acquired lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.network.neutron [req-fced4ab4-84a9-4b5b-b442-74c49eedcec1 req-9fa99503-9c31-4597-8395-b0a6e07ab86a service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Refreshing network info cache for port d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Start _get_guest_xml network_info=[{"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:51:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:51:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980352189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980352189',id=23,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540826be4baf46dba9617b2fd47821a3',ramdisk_id='',reservation_id='r-e6w3b40w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:51:37Z,user_data=None,user_id='d819e3f51368413c99691d1b45bbcfb1',uuid=188b31f8-8f5e-41b7-86c5-f0668ea52be7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converting VIF {"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=d0d89b4a-1f15-4597-921f-546dc4992df8,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d89b4a-1f') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.objects.instance [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lazy-loading 'pci_devices' on Instance uuid 188b31f8-8f5e-41b7-86c5-f0668ea52be7 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:51:39 user nova-compute[82617]:   <uuid>188b31f8-8f5e-41b7-86c5-f0668ea52be7</uuid>
Apr 17 15:51:39 user nova-compute[82617]:   <name>instance-00000017</name>
Apr 17 15:51:39 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:51:39 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:51:39 user nova-compute[82617]:   <metadata>
Apr 17 15:51:39 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:51:39 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:51:39 user nova-compute[82617]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-980352189</nova:name>
Apr 17 15:51:39 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:51:39</nova:creationTime>
Apr 17 15:51:39 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:51:39 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:51:39 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:51:39 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:51:39 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:51:39 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:51:39 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:51:39 user nova-compute[82617]:       <nova:owner>
Apr 17 15:51:39 user nova-compute[82617]:         <nova:user uuid="d819e3f51368413c99691d1b45bbcfb1">tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member</nova:user>
Apr 17 15:51:39 user nova-compute[82617]:         <nova:project uuid="540826be4baf46dba9617b2fd47821a3">tempest-ServerBootFromVolumeStableRescueTest-1271370980</nova:project>
Apr 17 15:51:39 user nova-compute[82617]:       </nova:owner>
Apr 17 15:51:39 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:51:39 user nova-compute[82617]:       <nova:ports>
Apr 17 15:51:39 user nova-compute[82617]:         <nova:port uuid="d0d89b4a-1f15-4597-921f-546dc4992df8">
Apr 17 15:51:39 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 15:51:39 user nova-compute[82617]:         </nova:port>
Apr 17 15:51:39 user nova-compute[82617]:       </nova:ports>
Apr 17 15:51:39 user nova-compute[82617]:     </nova:instance>
Apr 17 15:51:39 user nova-compute[82617]:   </metadata>
Apr 17 15:51:39 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:51:39 user nova-compute[82617]:     <system>
Apr 17 15:51:39 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:51:39 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:51:39 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:51:39 user nova-compute[82617]:       <entry name="serial">188b31f8-8f5e-41b7-86c5-f0668ea52be7</entry>
Apr 17 15:51:39 user nova-compute[82617]:       <entry name="uuid">188b31f8-8f5e-41b7-86c5-f0668ea52be7</entry>
Apr 17 15:51:39 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:51:39 user nova-compute[82617]:     </system>
Apr 17 15:51:39 user nova-compute[82617]:   </sysinfo>
Apr 17 15:51:39 user nova-compute[82617]:   <os>
Apr 17 15:51:39 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:51:39 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:51:39 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:51:39 user nova-compute[82617]:   </os>
Apr 17 15:51:39 user nova-compute[82617]:   <features>
Apr 17 15:51:39 user nova-compute[82617]:     <acpi/>
Apr 17 15:51:39 user nova-compute[82617]:     <apic/>
Apr 17 15:51:39 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:51:39 user nova-compute[82617]:   </features>
Apr 17 15:51:39 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:51:39 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:51:39 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:51:39 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:51:39 user nova-compute[82617]:   </clock>
Apr 17 15:51:39 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:51:39 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:51:39 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:51:39 user nova-compute[82617]:   </cpu>
Apr 17 15:51:39 user nova-compute[82617]:   <devices>
Apr 17 15:51:39 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:51:39 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:51:39 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk"/>
Apr 17 15:51:39 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:51:39 user nova-compute[82617]:     </disk>
Apr 17 15:51:39 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:51:39 user nova-compute[82617]:       <mac address="fa:16:3e:96:31:0f"/>
Apr 17 15:51:39 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:51:39 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:51:39 user nova-compute[82617]:       <target dev="tapd0d89b4a-1f"/>
Apr 17 15:51:39 user nova-compute[82617]:     </interface>
Apr 17 15:51:39 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:51:39 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/console.log" append="off"/>
Apr 17 15:51:39 user nova-compute[82617]:     </serial>
Apr 17 15:51:39 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:51:39 user nova-compute[82617]:     <video>
Apr 17 15:51:39 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:51:39 user nova-compute[82617]:     </video>
Apr 17 15:51:39 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:51:39 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:51:39 user nova-compute[82617]:     </rng>
Apr 17 15:51:39 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:51:39 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:51:39 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:51:39 user nova-compute[82617]:     </memballoon>
Apr 17 15:51:39 user nova-compute[82617]:   </devices>
Apr 17 15:51:39 user nova-compute[82617]: </domain>
Apr 17 15:51:39 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980352189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980352189',id=23,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540826be4baf46dba9617b2fd47821a3',ramdisk_id='',reservation_id='r-e6w3b40w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:51:37Z,user_data=None,user_id='d819e3f51368413c99691d1b45bbcfb1',uuid=188b31f8-8f5e-41b7-86c5-f0668ea52be7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converting VIF {"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=d0d89b4a-1f15-4597-921f-546dc4992df8,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d89b4a-1f') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG os_vif [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=d0d89b4a-1f15-4597-921f-546dc4992df8,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d89b4a-1f') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0d89b4a-1f, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0d89b4a-1f, col_values=(('external_ids', {'iface-id': 'd0d89b4a-1f15-4597-921f-546dc4992df8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:31:0f', 'vm-uuid': '188b31f8-8f5e-41b7-86c5-f0668ea52be7'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:39 user nova-compute[82617]: INFO os_vif [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=d0d89b4a-1f15-4597-921f-546dc4992df8,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d89b4a-1f')
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] No VIF found with MAC fa:16:3e:96:31:0f, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.network.neutron [req-fced4ab4-84a9-4b5b-b442-74c49eedcec1 req-9fa99503-9c31-4597-8395-b0a6e07ab86a service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Updated VIF entry in instance network info cache for port d0d89b4a-1f15-4597-921f-546dc4992df8. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG nova.network.neutron [req-fced4ab4-84a9-4b5b-b442-74c49eedcec1 req-9fa99503-9c31-4597-8395-b0a6e07ab86a service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Updating instance_info_cache with network_info: [{"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:51:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fced4ab4-84a9-4b5b-b442-74c49eedcec1 req-9fa99503-9c31-4597-8395-b0a6e07ab86a service nova] Releasing lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:51:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:41 user nova-compute[82617]: DEBUG nova.compute.manager [req-05d7d0f3-1e92-4174-bed9-db604cca23ba req-2d7d59be-acc7-4dff-a6e2-808c2d8dff51 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received event network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:51:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-05d7d0f3-1e92-4174-bed9-db604cca23ba req-2d7d59be-acc7-4dff-a6e2-808c2d8dff51 service nova] Acquiring lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-05d7d0f3-1e92-4174-bed9-db604cca23ba req-2d7d59be-acc7-4dff-a6e2-808c2d8dff51 service nova] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:41 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-05d7d0f3-1e92-4174-bed9-db604cca23ba req-2d7d59be-acc7-4dff-a6e2-808c2d8dff51 service nova] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:41 user nova-compute[82617]: DEBUG nova.compute.manager [req-05d7d0f3-1e92-4174-bed9-db604cca23ba req-2d7d59be-acc7-4dff-a6e2-808c2d8dff51 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] No waiting events found dispatching network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:51:41 user nova-compute[82617]: WARNING nova.compute.manager [req-05d7d0f3-1e92-4174-bed9-db604cca23ba req-2d7d59be-acc7-4dff-a6e2-808c2d8dff51 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received unexpected event network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 for instance with vm_state building and task_state spawning.
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746702.8172421, 188b31f8-8f5e-41b7-86c5-f0668ea52be7 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:51:42 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] VM Resumed (Lifecycle Event)
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:51:42 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Instance spawned successfully.
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:51:42 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746702.8191597, 188b31f8-8f5e-41b7-86c5-f0668ea52be7 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:51:42 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] VM Started (Lifecycle Event)
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:51:42 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:51:42 user nova-compute[82617]: INFO nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Took 5.61 seconds to spawn the instance on the hypervisor.
Apr 17 15:51:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:43 user nova-compute[82617]: INFO nova.compute.manager [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Took 6.39 seconds to build instance.
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-605e4dee-66cb-4b39-8507-143a70f4cc8d tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.493s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG nova.compute.manager [req-cbbd3d09-fbd3-4031-87ae-7d8d94312d0e req-973ad7c9-542b-43f6-a920-05a835770bbe service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received event network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cbbd3d09-fbd3-4031-87ae-7d8d94312d0e req-973ad7c9-542b-43f6-a920-05a835770bbe service nova] Acquiring lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cbbd3d09-fbd3-4031-87ae-7d8d94312d0e req-973ad7c9-542b-43f6-a920-05a835770bbe service nova] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cbbd3d09-fbd3-4031-87ae-7d8d94312d0e req-973ad7c9-542b-43f6-a920-05a835770bbe service nova] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG nova.compute.manager [req-cbbd3d09-fbd3-4031-87ae-7d8d94312d0e req-973ad7c9-542b-43f6-a920-05a835770bbe service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] No waiting events found dispatching network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:51:43 user nova-compute[82617]: WARNING nova.compute.manager [req-cbbd3d09-fbd3-4031-87ae-7d8d94312d0e req-973ad7c9-542b-43f6-a920-05a835770bbe service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received unexpected event network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 for instance with vm_state active and task_state None.
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:44 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:51:46 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:51:46 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7857MB free_disk=26.081687927246094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f4954e16-49b5-4815-9ffb-a45511525c20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:51:46 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:51:47 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:51:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:51:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:51:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:51:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:51:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:51:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 17 15:51:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 15:51:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:51:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:51:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:09 user nova-compute[82617]: ERROR nova.volume.cinder [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Delete attachment failed for attachment 1634a7d0-3313-448e-9888-8de015f268af. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-8dba5389-38e6-4a46-b382-2d4356cad7db) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-8dba5389-38e6-4a46-b382-2d4356cad7db)
Apr 17 15:52:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:52:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:52:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "f4954e16-49b5-4815-9ffb-a45511525c20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "f4954e16-49b5-4815-9ffb-a45511525c20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:52:32 user nova-compute[82617]: INFO nova.compute.manager [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Terminating instance
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-fd49dbad-ec29-45f2-9793-2364758dc216 req-8eb15e4f-729e-4272-8056-bf404be219d4 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received event network-vif-unplugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fd49dbad-ec29-45f2-9793-2364758dc216 req-8eb15e4f-729e-4272-8056-bf404be219d4 service nova] Acquiring lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fd49dbad-ec29-45f2-9793-2364758dc216 req-8eb15e4f-729e-4272-8056-bf404be219d4 service nova] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-fd49dbad-ec29-45f2-9793-2364758dc216 req-8eb15e4f-729e-4272-8056-bf404be219d4 service nova] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-fd49dbad-ec29-45f2-9793-2364758dc216 req-8eb15e4f-729e-4272-8056-bf404be219d4 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] No waiting events found dispatching network-vif-unplugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-fd49dbad-ec29-45f2-9793-2364758dc216 req-8eb15e4f-729e-4272-8056-bf404be219d4 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received event network-vif-unplugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:52:32 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Instance destroyed successfully.
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.objects.instance [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'resources' on Instance uuid f4954e16-49b5-4815-9ffb-a45511525c20 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1990565062',display_name='tempest-AttachVolumeNegativeTest-server-1990565062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1990565062',id=21,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5gLK3grZpOEk7iRtZNyBbbgxeHxgeVFh3vqpodjpnDKVqHd9qWhJCehEyA9oIDahe6o4qzdKUQyek+WAyKc7QO6+B72QibBjSyywyoAk3l4LHEgu0UsHrZOblxrkuNAg==',key_name='tempest-keypair-300961136',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-7jk3wri5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:47:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=f4954e16-49b5-4815-9ffb-a45511525c20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "address": "fa:16:3e:49:46:a6", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd71496-a7", "ovs_interfaceid": "dfd71496-a7b0-49a5-8b99-9c97cfb696ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:46:a6,bridge_name='br-int',has_traffic_filtering=True,id=dfd71496-a7b0-49a5-8b99-9c97cfb696ab,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd71496-a7') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG os_vif [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:46:a6,bridge_name='br-int',has_traffic_filtering=True,id=dfd71496-a7b0-49a5-8b99-9c97cfb696ab,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd71496-a7') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfd71496-a7, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:32 user nova-compute[82617]: INFO os_vif [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:46:a6,bridge_name='br-int',has_traffic_filtering=True,id=dfd71496-a7b0-49a5-8b99-9c97cfb696ab,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd71496-a7')
Apr 17 15:52:32 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Deleting instance files /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20_del
Apr 17 15:52:32 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Deletion of /opt/stack/data/nova/instances/f4954e16-49b5-4815-9ffb-a45511525c20_del complete
Apr 17 15:52:32 user nova-compute[82617]: INFO nova.compute.manager [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 17 15:52:32 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:52:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:33 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:52:33 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Took 0.73 seconds to deallocate network for instance.
Apr 17 15:52:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-02db5cf0-dd19-4d28-930d-6af82bcb338d req-659c77bb-e252-41f7-81e9-60e99b93fd72 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received event network-vif-deleted-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:52:33 user nova-compute[82617]: INFO nova.compute.manager [req-02db5cf0-dd19-4d28-930d-6af82bcb338d req-659c77bb-e252-41f7-81e9-60e99b93fd72 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Neutron deleted interface dfd71496-a7b0-49a5-8b99-9c97cfb696ab; detaching it from the instance and deleting it from the info cache
Apr 17 15:52:33 user nova-compute[82617]: DEBUG nova.network.neutron [req-02db5cf0-dd19-4d28-930d-6af82bcb338d req-659c77bb-e252-41f7-81e9-60e99b93fd72 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:52:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-02db5cf0-dd19-4d28-930d-6af82bcb338d req-659c77bb-e252-41f7-81e9-60e99b93fd72 service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Detach interface failed, port_id=dfd71496-a7b0-49a5-8b99-9c97cfb696ab, reason: Instance f4954e16-49b5-4815-9ffb-a45511525c20 could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:52:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:52:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:52:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:52:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:52:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:52:33 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Deleted allocations for instance f4954e16-49b5-4815-9ffb-a45511525c20
Apr 17 15:52:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-54c35616-a2b1-4abd-bdca-1472032408bb tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "f4954e16-49b5-4815-9ffb-a45511525c20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.907s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:52:34 user nova-compute[82617]: DEBUG nova.compute.manager [req-e61a0501-9c88-4925-99a7-458bcf77a436 req-8338791e-2e10-4bd9-a092-3942b2d6c72d service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received event network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:52:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e61a0501-9c88-4925-99a7-458bcf77a436 req-8338791e-2e10-4bd9-a092-3942b2d6c72d service nova] Acquiring lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:52:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e61a0501-9c88-4925-99a7-458bcf77a436 req-8338791e-2e10-4bd9-a092-3942b2d6c72d service nova] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:52:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e61a0501-9c88-4925-99a7-458bcf77a436 req-8338791e-2e10-4bd9-a092-3942b2d6c72d service nova] Lock "f4954e16-49b5-4815-9ffb-a45511525c20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:52:34 user nova-compute[82617]: DEBUG nova.compute.manager [req-e61a0501-9c88-4925-99a7-458bcf77a436 req-8338791e-2e10-4bd9-a092-3942b2d6c72d service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] No waiting events found dispatching network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:52:34 user nova-compute[82617]: WARNING nova.compute.manager [req-e61a0501-9c88-4925-99a7-458bcf77a436 req-8338791e-2e10-4bd9-a092-3942b2d6c72d service nova] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Received unexpected event network-vif-plugged-dfd71496-a7b0-49a5-8b99-9c97cfb696ab for instance with vm_state deleted and task_state None.
Apr 17 15:52:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681746752.692329, f4954e16-49b5-4815-9ffb-a45511525c20 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:52:47 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] VM Stopped (Lifecycle Event)
Apr 17 15:52:47 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:52:47 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:52:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7930MB free_disk=26.07691192626953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:52:47 user nova-compute[82617]: DEBUG nova.compute.manager [None req-62ac9c5e-baba-4a8c-b306-db82d6d1f115 None None] [instance: f4954e16-49b5-4815-9ffb-a45511525c20] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:52:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:52:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:52:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:52:56 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:52:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:52:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:52:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:53:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:53:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:53:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:53:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:53:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:53:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:53:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:53:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:53:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:53:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:53:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:53:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:53:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "13e89342-0216-425c-91ee-c94b7c47c21a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "13e89342-0216-425c-91ee-c94b7c47c21a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:53:26 user nova-compute[82617]: INFO nova.compute.claims [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Claim successful on node user
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:53:26 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.policy [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fdc7c80b4654692a52c8a4c4149324f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8586cc10142d4743874f43cdb0f37aba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:53:26 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Creating image(s)
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "/opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "/opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "/opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.148s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk 1073741824" returned: 0 in 0.052s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:26 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Successfully created port: ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Cannot resize image /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG nova.objects.instance [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'migration_context' on Instance uuid 13e89342-0216-425c-91ee-c94b7c47c21a {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Ensure instance console log exists: /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:53:27 user nova-compute[82617]: INFO nova.compute.manager [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] instance snapshotting
Apr 17 15:53:27 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Beginning live snapshot process
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json -f qcow2 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json -f qcow2 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Successfully updated port: ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquired lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv3r4skx4/2f600cc79793438d916cde17d3f85019.delta 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-583cb310-9bd3-4419-aa5c-56b3071d6699 req-92f1dddf-ff01-4ab4-b179-fc9b7986ecb9 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received event network-changed-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.compute.manager [req-583cb310-9bd3-4419-aa5c-56b3071d6699 req-92f1dddf-ff01-4ab4-b179-fc9b7986ecb9 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Refreshing instance network info cache due to event network-changed-ed586924-ddab-4ae0-82f5-ca6764d28cc3. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-583cb310-9bd3-4419-aa5c-56b3071d6699 req-92f1dddf-ff01-4ab4-b179-fc9b7986ecb9 service nova] Acquiring lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv3r4skx4/2f600cc79793438d916cde17d3f85019.delta 1073741824" returned: 0 in 0.067s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:28 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Updating instance_info_cache with network_info: [{"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Releasing lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Instance network_info: |[{"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-583cb310-9bd3-4419-aa5c-56b3071d6699 req-92f1dddf-ff01-4ab4-b179-fc9b7986ecb9 service nova] Acquired lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.network.neutron [req-583cb310-9bd3-4419-aa5c-56b3071d6699 req-92f1dddf-ff01-4ab4-b179-fc9b7986ecb9 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Refreshing network info cache for port ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Start _get_guest_xml network_info=[{"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:53:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:53:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1396692875',display_name='tempest-AttachVolumeNegativeTest-server-1396692875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1396692875',id=24,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE/xVpUhFcm/mFpuo6wsddZb/IHVvGvk+rj8AaH0iBe+IKMM2lu2l6t0DWVdpPqEwc2rLDUOQevT5tXwZbq7ExM5nk4SNwakHzCcvpo8dakaz2txrKqRAsidkYEjbJuhw==',key_name='tempest-keypair-2078252498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-scps6tot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=13e89342-0216-425c-91ee-c94b7c47c21a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2e:e3,bridge_name='br-int',has_traffic_filtering=True,id=ed586924-ddab-4ae0-82f5-ca6764d28cc3,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped586924-dd') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:53:28 user nova-compute[82617]: DEBUG nova.objects.instance [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'pci_devices' on Instance uuid 13e89342-0216-425c-91ee-c94b7c47c21a {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:53:29 user nova-compute[82617]:   <uuid>13e89342-0216-425c-91ee-c94b7c47c21a</uuid>
Apr 17 15:53:29 user nova-compute[82617]:   <name>instance-00000018</name>
Apr 17 15:53:29 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:53:29 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:53:29 user nova-compute[82617]:   <metadata>
Apr 17 15:53:29 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:53:29 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:53:29 user nova-compute[82617]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1396692875</nova:name>
Apr 17 15:53:29 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:53:28</nova:creationTime>
Apr 17 15:53:29 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:53:29 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:53:29 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:53:29 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:53:29 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:53:29 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:53:29 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:53:29 user nova-compute[82617]:       <nova:owner>
Apr 17 15:53:29 user nova-compute[82617]:         <nova:user uuid="9fdc7c80b4654692a52c8a4c4149324f">tempest-AttachVolumeNegativeTest-331389537-project-member</nova:user>
Apr 17 15:53:29 user nova-compute[82617]:         <nova:project uuid="8586cc10142d4743874f43cdb0f37aba">tempest-AttachVolumeNegativeTest-331389537</nova:project>
Apr 17 15:53:29 user nova-compute[82617]:       </nova:owner>
Apr 17 15:53:29 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:53:29 user nova-compute[82617]:       <nova:ports>
Apr 17 15:53:29 user nova-compute[82617]:         <nova:port uuid="ed586924-ddab-4ae0-82f5-ca6764d28cc3">
Apr 17 15:53:29 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 17 15:53:29 user nova-compute[82617]:         </nova:port>
Apr 17 15:53:29 user nova-compute[82617]:       </nova:ports>
Apr 17 15:53:29 user nova-compute[82617]:     </nova:instance>
Apr 17 15:53:29 user nova-compute[82617]:   </metadata>
Apr 17 15:53:29 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:53:29 user nova-compute[82617]:     <system>
Apr 17 15:53:29 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:53:29 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:53:29 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:53:29 user nova-compute[82617]:       <entry name="serial">13e89342-0216-425c-91ee-c94b7c47c21a</entry>
Apr 17 15:53:29 user nova-compute[82617]:       <entry name="uuid">13e89342-0216-425c-91ee-c94b7c47c21a</entry>
Apr 17 15:53:29 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:53:29 user nova-compute[82617]:     </system>
Apr 17 15:53:29 user nova-compute[82617]:   </sysinfo>
Apr 17 15:53:29 user nova-compute[82617]:   <os>
Apr 17 15:53:29 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:53:29 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:53:29 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:53:29 user nova-compute[82617]:   </os>
Apr 17 15:53:29 user nova-compute[82617]:   <features>
Apr 17 15:53:29 user nova-compute[82617]:     <acpi/>
Apr 17 15:53:29 user nova-compute[82617]:     <apic/>
Apr 17 15:53:29 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:53:29 user nova-compute[82617]:   </features>
Apr 17 15:53:29 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:53:29 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:53:29 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:53:29 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:53:29 user nova-compute[82617]:   </clock>
Apr 17 15:53:29 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:53:29 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:53:29 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:53:29 user nova-compute[82617]:   </cpu>
Apr 17 15:53:29 user nova-compute[82617]:   <devices>
Apr 17 15:53:29 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:53:29 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:53:29 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk"/>
Apr 17 15:53:29 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:53:29 user nova-compute[82617]:     </disk>
Apr 17 15:53:29 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:53:29 user nova-compute[82617]:       <mac address="fa:16:3e:04:2e:e3"/>
Apr 17 15:53:29 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:53:29 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:53:29 user nova-compute[82617]:       <target dev="taped586924-dd"/>
Apr 17 15:53:29 user nova-compute[82617]:     </interface>
Apr 17 15:53:29 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:53:29 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/console.log" append="off"/>
Apr 17 15:53:29 user nova-compute[82617]:     </serial>
Apr 17 15:53:29 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:53:29 user nova-compute[82617]:     <video>
Apr 17 15:53:29 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:53:29 user nova-compute[82617]:     </video>
Apr 17 15:53:29 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:53:29 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:53:29 user nova-compute[82617]:     </rng>
Apr 17 15:53:29 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:53:29 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:53:29 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:53:29 user nova-compute[82617]:     </memballoon>
Apr 17 15:53:29 user nova-compute[82617]:   </devices>
Apr 17 15:53:29 user nova-compute[82617]: </domain>
Apr 17 15:53:29 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1396692875',display_name='tempest-AttachVolumeNegativeTest-server-1396692875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1396692875',id=24,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE/xVpUhFcm/mFpuo6wsddZb/IHVvGvk+rj8AaH0iBe+IKMM2lu2l6t0DWVdpPqEwc2rLDUOQevT5tXwZbq7ExM5nk4SNwakHzCcvpo8dakaz2txrKqRAsidkYEjbJuhw==',key_name='tempest-keypair-2078252498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-scps6tot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=13e89342-0216-425c-91ee-c94b7c47c21a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2e:e3,bridge_name='br-int',has_traffic_filtering=True,id=ed586924-ddab-4ae0-82f5-ca6764d28cc3,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped586924-dd') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG os_vif [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2e:e3,bridge_name='br-int',has_traffic_filtering=True,id=ed586924-ddab-4ae0-82f5-ca6764d28cc3,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped586924-dd') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped586924-dd, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped586924-dd, col_values=(('external_ids', {'iface-id': 'ed586924-ddab-4ae0-82f5-ca6764d28cc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:2e:e3', 'vm-uuid': '13e89342-0216-425c-91ee-c94b7c47c21a'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:29 user nova-compute[82617]: INFO os_vif [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2e:e3,bridge_name='br-int',has_traffic_filtering=True,id=ed586924-ddab-4ae0-82f5-ca6764d28cc3,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped586924-dd')
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] No VIF found with MAC fa:16:3e:04:2e:e3, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.network.neutron [req-583cb310-9bd3-4419-aa5c-56b3071d6699 req-92f1dddf-ff01-4ab4-b179-fc9b7986ecb9 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Updated VIF entry in instance network info cache for port ed586924-ddab-4ae0-82f5-ca6764d28cc3. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.network.neutron [req-583cb310-9bd3-4419-aa5c-56b3071d6699 req-92f1dddf-ff01-4ab4-b179-fc9b7986ecb9 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Updating instance_info_cache with network_info: [{"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-583cb310-9bd3-4419-aa5c-56b3071d6699 req-92f1dddf-ff01-4ab4-b179-fc9b7986ecb9 service nova] Releasing lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.guest [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82617) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 17 15:53:29 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 17 15:53:29 user nova-compute[82617]: DEBUG nova.privsep.utils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82617) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 17 15:53:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv3r4skx4/2f600cc79793438d916cde17d3f85019.delta /opt/stack/data/nova/instances/snapshots/tmpv3r4skx4/2f600cc79793438d916cde17d3f85019 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:30 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv3r4skx4/2f600cc79793438d916cde17d3f85019.delta /opt/stack/data/nova/instances/snapshots/tmpv3r4skx4/2f600cc79793438d916cde17d3f85019" returned: 0 in 0.347s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:30 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Snapshot extracted, beginning image upload
Apr 17 15:53:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-8f60dfc9-491e-4e77-956a-48fe46920def req-be6f5e7d-5986-4516-9ad1-19229544d1d2 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received event network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:53:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f60dfc9-491e-4e77-956a-48fe46920def req-be6f5e7d-5986-4516-9ad1-19229544d1d2 service nova] Acquiring lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f60dfc9-491e-4e77-956a-48fe46920def req-be6f5e7d-5986-4516-9ad1-19229544d1d2 service nova] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f60dfc9-491e-4e77-956a-48fe46920def req-be6f5e7d-5986-4516-9ad1-19229544d1d2 service nova] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:30 user nova-compute[82617]: DEBUG nova.compute.manager [req-8f60dfc9-491e-4e77-956a-48fe46920def req-be6f5e7d-5986-4516-9ad1-19229544d1d2 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] No waiting events found dispatching network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:53:30 user nova-compute[82617]: WARNING nova.compute.manager [req-8f60dfc9-491e-4e77-956a-48fe46920def req-be6f5e7d-5986-4516-9ad1-19229544d1d2 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received unexpected event network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 for instance with vm_state building and task_state spawning.
Apr 17 15:53:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Snapshot image upload complete
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.compute.manager [None req-d083700f-352a-40a7-a94d-ecda9a6ffaaf tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Took 4.85 seconds to snapshot the instance on the hypervisor.
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746812.6207511, 13e89342-0216-425c-91ee-c94b7c47c21a => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] VM Resumed (Lifecycle Event)
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Instance spawned successfully.
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681746812.6220248, 13e89342-0216-425c-91ee-c94b7c47c21a => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] VM Started (Lifecycle Event)
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Took 6.20 seconds to spawn the instance on the hypervisor.
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:53:32 user nova-compute[82617]: INFO nova.compute.manager [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Took 6.87 seconds to build instance.
Apr 17 15:53:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-4c8c59b8-71d7-4b25-a573-e9aca6ecf492 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "13e89342-0216-425c-91ee-c94b7c47c21a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.972s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-9227e2b0-ba74-4365-a6ce-f820504e79a3 req-a5b9b132-9fcf-42ca-9126-eb19db6ddda0 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received event network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9227e2b0-ba74-4365-a6ce-f820504e79a3 req-a5b9b132-9fcf-42ca-9126-eb19db6ddda0 service nova] Acquiring lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9227e2b0-ba74-4365-a6ce-f820504e79a3 req-a5b9b132-9fcf-42ca-9126-eb19db6ddda0 service nova] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9227e2b0-ba74-4365-a6ce-f820504e79a3 req-a5b9b132-9fcf-42ca-9126-eb19db6ddda0 service nova] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-9227e2b0-ba74-4365-a6ce-f820504e79a3 req-a5b9b132-9fcf-42ca-9126-eb19db6ddda0 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] No waiting events found dispatching network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:53:32 user nova-compute[82617]: WARNING nova.compute.manager [req-9227e2b0-ba74-4365-a6ce-f820504e79a3 req-a5b9b132-9fcf-42ca-9126-eb19db6ddda0 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received unexpected event network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 for instance with vm_state active and task_state None.
Apr 17 15:53:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:53:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:53:48 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:53:48 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7889MB free_disk=26.017894744873047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 13e89342-0216-425c-91ee-c94b7c47c21a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:53:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:53:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:53:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:53:57 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:53:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:09 user nova-compute[82617]: ERROR nova.volume.cinder [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Delete attachment failed for attachment 1634a7d0-3313-448e-9888-8de015f268af. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-00547a1c-f80b-48db-8093-70f53a331fbe) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-00547a1c-f80b-48db-8093-70f53a331fbe)
Apr 17 15:54:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:54:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:54:32 user nova-compute[82617]: INFO nova.compute.manager [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Terminating instance
Apr 17 15:54:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-8801813b-9faf-4126-b20b-38146a548c8f req-a982efbc-7afb-4316-940d-dfab322e97a3 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-unplugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8801813b-9faf-4126-b20b-38146a548c8f req-a982efbc-7afb-4316-940d-dfab322e97a3 service nova] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8801813b-9faf-4126-b20b-38146a548c8f req-a982efbc-7afb-4316-940d-dfab322e97a3 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8801813b-9faf-4126-b20b-38146a548c8f req-a982efbc-7afb-4316-940d-dfab322e97a3 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-8801813b-9faf-4126-b20b-38146a548c8f req-a982efbc-7afb-4316-940d-dfab322e97a3 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] No waiting events found dispatching network-vif-unplugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-8801813b-9faf-4126-b20b-38146a548c8f req-a982efbc-7afb-4316-940d-dfab322e97a3 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-unplugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:32 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Instance destroyed successfully.
Apr 17 15:54:32 user nova-compute[82617]: DEBUG nova.objects.instance [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'resources' on Instance uuid f67fa07e-0d72-4fc4-a96a-9271dd8e340b {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1266906511',display_name='tempest-ServerRescueNegativeTestJSON-server-1266906511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1266906511',id=17,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:41:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9324c99bd4d040bdb5a7f1db782b2783',ramdisk_id='',reservation_id='r-5af3f2wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1346397943',owner_user_name='tempest-ServerRescueNegativeTestJSON-1346397943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:41:58Z,user_data=None,user_id='8e3487d6b32d46beac556617050fd664',uuid=f67fa07e-0d72-4fc4-a96a-9271dd8e340b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converting VIF {"id": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "address": "fa:16:3e:41:09:af", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ec3ccd-f3", "ovs_interfaceid": "34ec3ccd-f3eb-4481-85c5-90b55f4c2c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:09:af,bridge_name='br-int',has_traffic_filtering=True,id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ec3ccd-f3') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG os_vif [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:09:af,bridge_name='br-int',has_traffic_filtering=True,id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ec3ccd-f3') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34ec3ccd-f3, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:54:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:32 user nova-compute[82617]: INFO os_vif [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:09:af,bridge_name='br-int',has_traffic_filtering=True,id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ec3ccd-f3')
Apr 17 15:54:32 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Deleting instance files /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b_del
Apr 17 15:54:33 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Deletion of /opt/stack/data/nova/instances/f67fa07e-0d72-4fc4-a96a-9271dd8e340b_del complete
Apr 17 15:54:33 user nova-compute[82617]: INFO nova.compute.manager [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 17 15:54:33 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:54:33 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:54:33 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:54:33 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:54:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-93da905b-420b-4ed3-8e8d-31765e4c43b5 req-9133111c-3c67-4aef-a87a-ca7f62ab47bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-deleted-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:54:33 user nova-compute[82617]: INFO nova.compute.manager [req-93da905b-420b-4ed3-8e8d-31765e4c43b5 req-9133111c-3c67-4aef-a87a-ca7f62ab47bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Neutron deleted interface 34ec3ccd-f3eb-4481-85c5-90b55f4c2c67; detaching it from the instance and deleting it from the info cache
Apr 17 15:54:33 user nova-compute[82617]: DEBUG nova.network.neutron [req-93da905b-420b-4ed3-8e8d-31765e4c43b5 req-9133111c-3c67-4aef-a87a-ca7f62ab47bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:54:33 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Took 0.75 seconds to deallocate network for instance.
Apr 17 15:54:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-93da905b-420b-4ed3-8e8d-31765e4c43b5 req-9133111c-3c67-4aef-a87a-ca7f62ab47bb service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Detach interface failed, port_id=34ec3ccd-f3eb-4481-85c5-90b55f4c2c67, reason: Instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:54:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "f3ff2eef-2305-4c49-8081-aea9a8dfe448" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "f3ff2eef-2305-4c49-8081-aea9a8dfe448" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:54:34 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Deleted allocations for instance f67fa07e-0d72-4fc4-a96a-9271dd8e340b
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:54:34 user nova-compute[82617]: INFO nova.compute.claims [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Claim successful on node user
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dc837874-7658-41b7-8bed-4b74bc94fc7e tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.compute.manager [req-7e85a27e-f6a3-41e3-a074-d4dabfdbef6f req-2b29bb03-4d0d-4f37-9cfa-eb244ac10b79 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e85a27e-f6a3-41e3-a074-d4dabfdbef6f req-2b29bb03-4d0d-4f37-9cfa-eb244ac10b79 service nova] Acquiring lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e85a27e-f6a3-41e3-a074-d4dabfdbef6f req-2b29bb03-4d0d-4f37-9cfa-eb244ac10b79 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7e85a27e-f6a3-41e3-a074-d4dabfdbef6f req-2b29bb03-4d0d-4f37-9cfa-eb244ac10b79 service nova] Lock "f67fa07e-0d72-4fc4-a96a-9271dd8e340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.compute.manager [req-7e85a27e-f6a3-41e3-a074-d4dabfdbef6f req-2b29bb03-4d0d-4f37-9cfa-eb244ac10b79 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] No waiting events found dispatching network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:54:34 user nova-compute[82617]: WARNING nova.compute.manager [req-7e85a27e-f6a3-41e3-a074-d4dabfdbef6f req-2b29bb03-4d0d-4f37-9cfa-eb244ac10b79 service nova] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Received unexpected event network-vif-plugged-34ec3ccd-f3eb-4481-85c5-90b55f4c2c67 for instance with vm_state deleted and task_state None.
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:54:34 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:54:34 user nova-compute[82617]: INFO nova.virt.block_device [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Booting with volume-backed-image b3f0dec1-7758-44a8-82e0-76ada8837428 at /dev/vda
Apr 17 15:54:34 user nova-compute[82617]: DEBUG nova.policy [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd819e3f51368413c99691d1b45bbcfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540826be4baf46dba9617b2fd47821a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:54:35 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Successfully created port: a4eadaf2-bba7-481f-b3b3-c28362f0864f {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Successfully updated port: a4eadaf2-bba7-481f-b3b3-c28362f0864f {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "refresh_cache-f3ff2eef-2305-4c49-8081-aea9a8dfe448" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquired lock "refresh_cache-f3ff2eef-2305-4c49-8081-aea9a8dfe448" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-53e780de-9a27-495d-9ca1-94768f60471c req-f4c9123c-9fd8-4d2b-aa5f-9403e99d4301 service nova] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Received event network-changed-a4eadaf2-bba7-481f-b3b3-c28362f0864f {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-53e780de-9a27-495d-9ca1-94768f60471c req-f4c9123c-9fd8-4d2b-aa5f-9403e99d4301 service nova] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Refreshing instance network info cache due to event network-changed-a4eadaf2-bba7-481f-b3b3-c28362f0864f. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-53e780de-9a27-495d-9ca1-94768f60471c req-f4c9123c-9fd8-4d2b-aa5f-9403e99d4301 service nova] Acquiring lock "refresh_cache-f3ff2eef-2305-4c49-8081-aea9a8dfe448" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Updating instance_info_cache with network_info: [{"id": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "address": "fa:16:3e:83:3e:b9", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4eadaf2-bb", "ovs_interfaceid": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Releasing lock "refresh_cache-f3ff2eef-2305-4c49-8081-aea9a8dfe448" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Instance network_info: |[{"id": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "address": "fa:16:3e:83:3e:b9", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4eadaf2-bb", "ovs_interfaceid": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-53e780de-9a27-495d-9ca1-94768f60471c req-f4c9123c-9fd8-4d2b-aa5f-9403e99d4301 service nova] Acquired lock "refresh_cache-f3ff2eef-2305-4c49-8081-aea9a8dfe448" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:54:36 user nova-compute[82617]: DEBUG nova.network.neutron [req-53e780de-9a27-495d-9ca1-94768f60471c req-f4c9123c-9fd8-4d2b-aa5f-9403e99d4301 service nova] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Refreshing network info cache for port a4eadaf2-bba7-481f-b3b3-c28362f0864f {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:54:37 user nova-compute[82617]: DEBUG nova.network.neutron [req-53e780de-9a27-495d-9ca1-94768f60471c req-f4c9123c-9fd8-4d2b-aa5f-9403e99d4301 service nova] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Updated VIF entry in instance network info cache for port a4eadaf2-bba7-481f-b3b3-c28362f0864f. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:54:37 user nova-compute[82617]: DEBUG nova.network.neutron [req-53e780de-9a27-495d-9ca1-94768f60471c req-f4c9123c-9fd8-4d2b-aa5f-9403e99d4301 service nova] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Updating instance_info_cache with network_info: [{"id": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "address": "fa:16:3e:83:3e:b9", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4eadaf2-bb", "ovs_interfaceid": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:54:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-53e780de-9a27-495d-9ca1-94768f60471c req-f4c9123c-9fd8-4d2b-aa5f-9403e99d4301 service nova] Releasing lock "refresh_cache-f3ff2eef-2305-4c49-8081-aea9a8dfe448" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:54:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 15:54:41 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 15:54:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:45 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:46 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:54:47 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:54:47 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7908MB free_disk=26.043319702148438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 13e89342-0216-425c-91ee-c94b7c47c21a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681746872.939379, f67fa07e-0d72-4fc4-a96a-9271dd8e340b => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:54:47 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] VM Stopped (Lifecycle Event)
Apr 17 15:54:47 user nova-compute[82617]: DEBUG nova.compute.manager [None req-1a16c52b-55af-4d24-9025-7235da55a683 None None] [instance: f67fa07e-0d72-4fc4-a96a-9271dd8e340b] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:54:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:48 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:54:48 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:54:48 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:54:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:54:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:56 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updating instance_info_cache with network_info: [{"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:54:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:55:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:01 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 15:55:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:06 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:55:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:55:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:55:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:55:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-72887bd6-039f-4f91-bfe8-91d9783435f3 req-b3e14f49-a9bd-4cf2-a69a-256ca8f980b8 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received event network-changed-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-72887bd6-039f-4f91-bfe8-91d9783435f3 req-b3e14f49-a9bd-4cf2-a69a-256ca8f980b8 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Refreshing instance network info cache due to event network-changed-ed586924-ddab-4ae0-82f5-ca6764d28cc3. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-72887bd6-039f-4f91-bfe8-91d9783435f3 req-b3e14f49-a9bd-4cf2-a69a-256ca8f980b8 service nova] Acquiring lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-72887bd6-039f-4f91-bfe8-91d9783435f3 req-b3e14f49-a9bd-4cf2-a69a-256ca8f980b8 service nova] Acquired lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG nova.network.neutron [req-72887bd6-039f-4f91-bfe8-91d9783435f3 req-b3e14f49-a9bd-4cf2-a69a-256ca8f980b8 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Refreshing network info cache for port ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG nova.network.neutron [req-72887bd6-039f-4f91-bfe8-91d9783435f3 req-b3e14f49-a9bd-4cf2-a69a-256ca8f980b8 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Updated VIF entry in instance network info cache for port ed586924-ddab-4ae0-82f5-ca6764d28cc3. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG nova.network.neutron [req-72887bd6-039f-4f91-bfe8-91d9783435f3 req-b3e14f49-a9bd-4cf2-a69a-256ca8f980b8 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Updating instance_info_cache with network_info: [{"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-72887bd6-039f-4f91-bfe8-91d9783435f3 req-b3e14f49-a9bd-4cf2-a69a-256ca8f980b8 service nova] Releasing lock "refresh_cache-13e89342-0216-425c-91ee-c94b7c47c21a" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:55:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:55:22 user nova-compute[82617]: INFO nova.compute.manager [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Terminating instance
Apr 17 15:55:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-8f616b2d-ef58-4edd-b7bd-464185028653 req-65c6eb1b-35f4-4e8d-a569-f19332fc73c0 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received event network-vif-unplugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f616b2d-ef58-4edd-b7bd-464185028653 req-65c6eb1b-35f4-4e8d-a569-f19332fc73c0 service nova] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f616b2d-ef58-4edd-b7bd-464185028653 req-65c6eb1b-35f4-4e8d-a569-f19332fc73c0 service nova] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8f616b2d-ef58-4edd-b7bd-464185028653 req-65c6eb1b-35f4-4e8d-a569-f19332fc73c0 service nova] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-8f616b2d-ef58-4edd-b7bd-464185028653 req-65c6eb1b-35f4-4e8d-a569-f19332fc73c0 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] No waiting events found dispatching network-vif-unplugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-8f616b2d-ef58-4edd-b7bd-464185028653 req-65c6eb1b-35f4-4e8d-a569-f19332fc73c0 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received event network-vif-unplugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:55:23 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Instance destroyed successfully.
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.objects.instance [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lazy-loading 'resources' on Instance uuid aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-310684687',display_name='tempest-ServerRescueNegativeTestJSON-server-310684687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-310684687',id=16,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:40:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9324c99bd4d040bdb5a7f1db782b2783',ramdisk_id='',reservation_id='r-7atsda10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1346397943',owner_user_name='tempest-ServerRescueNegativeTestJSON-1346397943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:40:09Z,user_data=None,user_id='8e3487d6b32d46beac556617050fd664',uuid=aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converting VIF {"id": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "address": "fa:16:3e:1b:58:64", "network": {"id": "4c047614-ff1f-49c7-b345-a937d92b9a80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1306734675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9324c99bd4d040bdb5a7f1db782b2783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15293fd3-2a", "ovs_interfaceid": "15293fd3-2a49-42bb-ab80-de44a94a83c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:58:64,bridge_name='br-int',has_traffic_filtering=True,id=15293fd3-2a49-42bb-ab80-de44a94a83c5,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15293fd3-2a') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG os_vif [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:58:64,bridge_name='br-int',has_traffic_filtering=True,id=15293fd3-2a49-42bb-ab80-de44a94a83c5,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15293fd3-2a') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15293fd3-2a, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:23 user nova-compute[82617]: INFO os_vif [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:58:64,bridge_name='br-int',has_traffic_filtering=True,id=15293fd3-2a49-42bb-ab80-de44a94a83c5,network=Network(4c047614-ff1f-49c7-b345-a937d92b9a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15293fd3-2a')
Apr 17 15:55:23 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Deleting instance files /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a_del
Apr 17 15:55:23 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Deletion of /opt/stack/data/nova/instances/aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a_del complete
Apr 17 15:55:23 user nova-compute[82617]: INFO nova.compute.manager [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 17 15:55:23 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.compute.manager [req-25cac942-a784-4b25-8777-f4abb4e4b014 req-e2ef1f45-d0b2-4b1d-a8ee-269998a97a66 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received event network-vif-deleted-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:55:23 user nova-compute[82617]: INFO nova.compute.manager [req-25cac942-a784-4b25-8777-f4abb4e4b014 req-e2ef1f45-d0b2-4b1d-a8ee-269998a97a66 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Neutron deleted interface 15293fd3-2a49-42bb-ab80-de44a94a83c5; detaching it from the instance and deleting it from the info cache
Apr 17 15:55:23 user nova-compute[82617]: DEBUG nova.network.neutron [req-25cac942-a784-4b25-8777-f4abb4e4b014 req-e2ef1f45-d0b2-4b1d-a8ee-269998a97a66 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:55:24 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Took 0.45 seconds to deallocate network for instance.
Apr 17 15:55:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-25cac942-a784-4b25-8777-f4abb4e4b014 req-e2ef1f45-d0b2-4b1d-a8ee-269998a97a66 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Detach interface failed, port_id=15293fd3-2a49-42bb-ab80-de44a94a83c5, reason: Instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:55:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:55:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:55:24 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:55:24 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:55:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:55:24 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Deleted allocations for instance aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a
Apr 17 15:55:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-f597e8a2-aa0a-4203-ac9c-3be8149e1037 tempest-ServerRescueNegativeTestJSON-1346397943 tempest-ServerRescueNegativeTestJSON-1346397943-project-member] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.659s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:55:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-3d5c5905-cd31-4173-93e8-ac3c3e88bc66 req-35f46530-2ecb-466b-8194-c71ec51ad855 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received event network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:55:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3d5c5905-cd31-4173-93e8-ac3c3e88bc66 req-35f46530-2ecb-466b-8194-c71ec51ad855 service nova] Acquiring lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:55:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3d5c5905-cd31-4173-93e8-ac3c3e88bc66 req-35f46530-2ecb-466b-8194-c71ec51ad855 service nova] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:55:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3d5c5905-cd31-4173-93e8-ac3c3e88bc66 req-35f46530-2ecb-466b-8194-c71ec51ad855 service nova] Lock "aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:55:25 user nova-compute[82617]: DEBUG nova.compute.manager [req-3d5c5905-cd31-4173-93e8-ac3c3e88bc66 req-35f46530-2ecb-466b-8194-c71ec51ad855 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] No waiting events found dispatching network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:55:25 user nova-compute[82617]: WARNING nova.compute.manager [req-3d5c5905-cd31-4173-93e8-ac3c3e88bc66 req-35f46530-2ecb-466b-8194-c71ec51ad855 service nova] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Received unexpected event network-vif-plugged-15293fd3-2a49-42bb-ab80-de44a94a83c5 for instance with vm_state deleted and task_state None.
Apr 17 15:55:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:38 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681746923.4277532, aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:55:38 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] VM Stopped (Lifecycle Event)
Apr 17 15:55:38 user nova-compute[82617]: DEBUG nova.compute.manager [None req-1a580fa4-eb27-4e3b-b3dd-391ff11ffc2b None None] [instance: aa3ffd0e-af5f-4604-a03b-a5754c5e4e2a] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:55:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:55:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:55:49 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:55:49 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=26.06053924560547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 13e89342-0216-425c-91ee-c94b7c47c21a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:55:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:55:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:55:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:55:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:55:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:55:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:55:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:55:59 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:55:59 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updating instance_info_cache with network_info: [{"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:55:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:55:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:56:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:56:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:09 user nova-compute[82617]: ERROR nova.volume.cinder [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Delete attachment failed for attachment 1634a7d0-3313-448e-9888-8de015f268af. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-4c60ec5b-6ff0-4c1b-b3ee-f1f60ca15f44) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-4c60ec5b-6ff0-4c1b-b3ee-f1f60ca15f44)
Apr 17 15:56:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:56:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:56:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:56:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:47 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:56:48 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:56:49 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:56:49 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8009MB free_disk=26.049392700195312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 13e89342-0216-425c-91ee-c94b7c47c21a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:56:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:56:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:56:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:56:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:56:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:57:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:01 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:57:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:57:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:57:01 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:57:01 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Updating instance_info_cache with network_info: [{"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:57:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-a5d93724-6e77-4b84-8402-812538223cb8" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:57:01 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:57:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:57:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:57:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:57:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:57:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:57:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:57:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:57:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:57:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:57:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:57:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:57:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:57:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:57:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 15:57:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:57:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 15:57:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:57:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:57:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:57:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:57:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:57:51 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:57:51 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8020MB free_disk=26.045242309570312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 13e89342-0216-425c-91ee-c94b7c47c21a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:57:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:57:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:57:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:57:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:57:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:58:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:58:03 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:58:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:58:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:58:03 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:58:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Updating instance_info_cache with network_info: [{"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:58:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-188b31f8-8f5e-41b7-86c5-f0668ea52be7" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:58:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:58:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:58:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:58:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:58:06 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:58:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:58:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:09 user nova-compute[82617]: ERROR nova.volume.cinder [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Delete attachment failed for attachment 1634a7d0-3313-448e-9888-8de015f268af. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-6d72b587-594c-4309-b424-7292ebb80925) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-6d72b587-594c-4309-b424-7292ebb80925)
Apr 17 15:58:09 user nova-compute[82617]: WARNING nova.compute.manager [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Ignoring unknown cinder exception for volume 13bf568b-585c-4556-ab78-e9930ad50214: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-6d72b587-594c-4309-b424-7292ebb80925): cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-6d72b587-594c-4309-b424-7292ebb80925)
Apr 17 15:58:09 user nova-compute[82617]: INFO nova.compute.manager [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] Took 600.24 seconds to detach 1 volumes for instance.
Apr 17 15:58:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:09 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:58:09 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:58:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:09 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Deleted allocations for instance 6aab9803-ab51-47c6-a2a2-739a7a18f5dc
Apr 17 15:58:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-778c62be-8963-4e6d-97f1-f456b759ce16 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 663.169s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 485.182s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:09 user nova-compute[82617]: INFO nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 6aab9803-ab51-47c6-a2a2-739a7a18f5dc] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 17 15:58:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "6aab9803-ab51-47c6-a2a2-739a7a18f5dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:58:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "13e89342-0216-425c-91ee-c94b7c47c21a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "13e89342-0216-425c-91ee-c94b7c47c21a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:33 user nova-compute[82617]: INFO nova.compute.manager [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Terminating instance
Apr 17 15:58:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-2cf8fb07-af01-418d-8be7-a3a9d5166d5f req-91c19853-a43f-4ad3-8779-44aa280406f1 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received event network-vif-unplugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2cf8fb07-af01-418d-8be7-a3a9d5166d5f req-91c19853-a43f-4ad3-8779-44aa280406f1 service nova] Acquiring lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2cf8fb07-af01-418d-8be7-a3a9d5166d5f req-91c19853-a43f-4ad3-8779-44aa280406f1 service nova] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2cf8fb07-af01-418d-8be7-a3a9d5166d5f req-91c19853-a43f-4ad3-8779-44aa280406f1 service nova] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-2cf8fb07-af01-418d-8be7-a3a9d5166d5f req-91c19853-a43f-4ad3-8779-44aa280406f1 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] No waiting events found dispatching network-vif-unplugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:58:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-2cf8fb07-af01-418d-8be7-a3a9d5166d5f req-91c19853-a43f-4ad3-8779-44aa280406f1 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received event network-vif-unplugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:34 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Instance destroyed successfully.
Apr 17 15:58:34 user nova-compute[82617]: DEBUG nova.objects.instance [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'resources' on Instance uuid 13e89342-0216-425c-91ee-c94b7c47c21a {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1396692875',display_name='tempest-AttachVolumeNegativeTest-server-1396692875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1396692875',id=24,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE/xVpUhFcm/mFpuo6wsddZb/IHVvGvk+rj8AaH0iBe+IKMM2lu2l6t0DWVdpPqEwc2rLDUOQevT5tXwZbq7ExM5nk4SNwakHzCcvpo8dakaz2txrKqRAsidkYEjbJuhw==',key_name='tempest-keypair-2078252498',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:53:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-scps6tot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=13e89342-0216-425c-91ee-c94b7c47c21a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "address": "fa:16:3e:04:2e:e3", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped586924-dd", "ovs_interfaceid": "ed586924-ddab-4ae0-82f5-ca6764d28cc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:2e:e3,bridge_name='br-int',has_traffic_filtering=True,id=ed586924-ddab-4ae0-82f5-ca6764d28cc3,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped586924-dd') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG os_vif [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2e:e3,bridge_name='br-int',has_traffic_filtering=True,id=ed586924-ddab-4ae0-82f5-ca6764d28cc3,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped586924-dd') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped586924-dd, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:34 user nova-compute[82617]: INFO os_vif [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2e:e3,bridge_name='br-int',has_traffic_filtering=True,id=ed586924-ddab-4ae0-82f5-ca6764d28cc3,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped586924-dd')
Apr 17 15:58:34 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Deleting instance files /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a_del
Apr 17 15:58:34 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Deletion of /opt/stack/data/nova/instances/13e89342-0216-425c-91ee-c94b7c47c21a_del complete
Apr 17 15:58:34 user nova-compute[82617]: INFO nova.compute.manager [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 17 15:58:34 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:58:34 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:58:35 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Took 0.69 seconds to deallocate network for instance.
Apr 17 15:58:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-15a7f07d-b29d-42b1-a24b-5c4022d4b208 req-2e066156-b59e-4bc1-89c6-def3e5a76ff9 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received event network-vif-deleted-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:35 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Deleted allocations for instance 13e89342-0216-425c-91ee-c94b7c47c21a
Apr 17 15:58:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-c49e04f9-ccaf-4cdc-859c-8908e19794f3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "13e89342-0216-425c-91ee-c94b7c47c21a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-03f435b8-5688-4944-80a9-59a605d0f7c1 req-542245cf-31af-460a-9519-c400bdce42c1 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received event network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-03f435b8-5688-4944-80a9-59a605d0f7c1 req-542245cf-31af-460a-9519-c400bdce42c1 service nova] Acquiring lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-03f435b8-5688-4944-80a9-59a605d0f7c1 req-542245cf-31af-460a-9519-c400bdce42c1 service nova] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-03f435b8-5688-4944-80a9-59a605d0f7c1 req-542245cf-31af-460a-9519-c400bdce42c1 service nova] Lock "13e89342-0216-425c-91ee-c94b7c47c21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-03f435b8-5688-4944-80a9-59a605d0f7c1 req-542245cf-31af-460a-9519-c400bdce42c1 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] No waiting events found dispatching network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:58:35 user nova-compute[82617]: WARNING nova.compute.manager [req-03f435b8-5688-4944-80a9-59a605d0f7c1 req-542245cf-31af-460a-9519-c400bdce42c1 service nova] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Received unexpected event network-vif-plugged-ed586924-ddab-4ae0-82f5-ca6764d28cc3 for instance with vm_state deleted and task_state None.
Apr 17 15:58:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681747114.2082026, 13e89342-0216-425c-91ee-c94b7c47c21a => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:58:49 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] VM Stopped (Lifecycle Event)
Apr 17 15:58:49 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3572477c-6b09-4369-8fff-e336f29a26a2 None None] [instance: 13e89342-0216-425c-91ee-c94b7c47c21a] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:49 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:51 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:58:51 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8069MB free_disk=26.062297821044922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:58:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "38365a85-808f-46c5-a327-53d066e893b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "38365a85-808f-46c5-a327-53d066e893b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:58:53 user nova-compute[82617]: INFO nova.compute.claims [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Claim successful on node user
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:58:53 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.policy [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83b9d77de46143d8b9277a55f5ad4d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214a0f233f114d7aa22e64048a837c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:58:53 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Creating image(s)
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "/opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "/opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "/opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk 1073741824" returned: 0 in 0.047s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.154s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Successfully created port: 087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Cannot resize image /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG nova.objects.instance [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'migration_context' on Instance uuid 38365a85-808f-46c5-a327-53d066e893b2 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Ensure instance console log exists: /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Successfully updated port: 087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquired lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.compute.manager [req-017a7ebb-e520-44f9-a9b2-f57fc68eaf81 req-2df1b37c-53e4-4683-93fa-e2e9d67e2502 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received event network-changed-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.compute.manager [req-017a7ebb-e520-44f9-a9b2-f57fc68eaf81 req-2df1b37c-53e4-4683-93fa-e2e9d67e2502 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Refreshing instance network info cache due to event network-changed-087adeb5-b86e-4577-9c66-6c2e4cc2906c. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-017a7ebb-e520-44f9-a9b2-f57fc68eaf81 req-2df1b37c-53e4-4683-93fa-e2e9d67e2502 service nova] Acquiring lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Updating instance_info_cache with network_info: [{"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Releasing lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Instance network_info: |[{"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-017a7ebb-e520-44f9-a9b2-f57fc68eaf81 req-2df1b37c-53e4-4683-93fa-e2e9d67e2502 service nova] Acquired lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.neutron [req-017a7ebb-e520-44f9-a9b2-f57fc68eaf81 req-2df1b37c-53e4-4683-93fa-e2e9d67e2502 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Refreshing network info cache for port 087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Start _get_guest_xml network_info=[{"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:58:55 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:58:55 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-190485391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-190485391',id=26,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLUDO5kr+TzN9QSRVENAgbTi002Im2KRK4Z00OTSPxRKMe64Q+U+t43hnN0XOSQSYON7DApnbUI7CMb3+HANI8hZA72BQFliWgUcDWJ6MBHMPUPV+p+meMIC0j9hgBM8w==',key_name='tempest-keypair-77898027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-vis8l380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=38365a85-808f-46c5-a327-53d066e893b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:69:6f,bridge_name='br-int',has_traffic_filtering=True,id=087adeb5-b86e-4577-9c66-6c2e4cc2906c,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087adeb5-b8') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.objects.instance [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'pci_devices' on Instance uuid 38365a85-808f-46c5-a327-53d066e893b2 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:58:55 user nova-compute[82617]:   <uuid>38365a85-808f-46c5-a327-53d066e893b2</uuid>
Apr 17 15:58:55 user nova-compute[82617]:   <name>instance-0000001a</name>
Apr 17 15:58:55 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:58:55 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:58:55 user nova-compute[82617]:   <metadata>
Apr 17 15:58:55 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:58:55 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:58:55 user nova-compute[82617]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-190485391</nova:name>
Apr 17 15:58:55 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:58:55</nova:creationTime>
Apr 17 15:58:55 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:58:55 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:58:55 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:58:55 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:58:55 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:58:55 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:58:55 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:58:55 user nova-compute[82617]:       <nova:owner>
Apr 17 15:58:55 user nova-compute[82617]:         <nova:user uuid="83b9d77de46143d8b9277a55f5ad4d72">tempest-AttachVolumeShelveTestJSON-1745617049-project-member</nova:user>
Apr 17 15:58:55 user nova-compute[82617]:         <nova:project uuid="214a0f233f114d7aa22e64048a837c0b">tempest-AttachVolumeShelveTestJSON-1745617049</nova:project>
Apr 17 15:58:55 user nova-compute[82617]:       </nova:owner>
Apr 17 15:58:55 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:58:55 user nova-compute[82617]:       <nova:ports>
Apr 17 15:58:55 user nova-compute[82617]:         <nova:port uuid="087adeb5-b86e-4577-9c66-6c2e4cc2906c">
Apr 17 15:58:55 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 17 15:58:55 user nova-compute[82617]:         </nova:port>
Apr 17 15:58:55 user nova-compute[82617]:       </nova:ports>
Apr 17 15:58:55 user nova-compute[82617]:     </nova:instance>
Apr 17 15:58:55 user nova-compute[82617]:   </metadata>
Apr 17 15:58:55 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:58:55 user nova-compute[82617]:     <system>
Apr 17 15:58:55 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:58:55 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:58:55 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:58:55 user nova-compute[82617]:       <entry name="serial">38365a85-808f-46c5-a327-53d066e893b2</entry>
Apr 17 15:58:55 user nova-compute[82617]:       <entry name="uuid">38365a85-808f-46c5-a327-53d066e893b2</entry>
Apr 17 15:58:55 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:58:55 user nova-compute[82617]:     </system>
Apr 17 15:58:55 user nova-compute[82617]:   </sysinfo>
Apr 17 15:58:55 user nova-compute[82617]:   <os>
Apr 17 15:58:55 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:58:55 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:58:55 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:58:55 user nova-compute[82617]:   </os>
Apr 17 15:58:55 user nova-compute[82617]:   <features>
Apr 17 15:58:55 user nova-compute[82617]:     <acpi/>
Apr 17 15:58:55 user nova-compute[82617]:     <apic/>
Apr 17 15:58:55 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:58:55 user nova-compute[82617]:   </features>
Apr 17 15:58:55 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:58:55 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:58:55 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:58:55 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:58:55 user nova-compute[82617]:   </clock>
Apr 17 15:58:55 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:58:55 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:58:55 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:58:55 user nova-compute[82617]:   </cpu>
Apr 17 15:58:55 user nova-compute[82617]:   <devices>
Apr 17 15:58:55 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:58:55 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:58:55 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk"/>
Apr 17 15:58:55 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:58:55 user nova-compute[82617]:     </disk>
Apr 17 15:58:55 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:58:55 user nova-compute[82617]:       <mac address="fa:16:3e:f6:69:6f"/>
Apr 17 15:58:55 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:58:55 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:58:55 user nova-compute[82617]:       <target dev="tap087adeb5-b8"/>
Apr 17 15:58:55 user nova-compute[82617]:     </interface>
Apr 17 15:58:55 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:58:55 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/console.log" append="off"/>
Apr 17 15:58:55 user nova-compute[82617]:     </serial>
Apr 17 15:58:55 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:58:55 user nova-compute[82617]:     <video>
Apr 17 15:58:55 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:58:55 user nova-compute[82617]:     </video>
Apr 17 15:58:55 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:58:55 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:58:55 user nova-compute[82617]:     </rng>
Apr 17 15:58:55 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:58:55 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:58:55 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:58:55 user nova-compute[82617]:     </memballoon>
Apr 17 15:58:55 user nova-compute[82617]:   </devices>
Apr 17 15:58:55 user nova-compute[82617]: </domain>
Apr 17 15:58:55 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-190485391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-190485391',id=26,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLUDO5kr+TzN9QSRVENAgbTi002Im2KRK4Z00OTSPxRKMe64Q+U+t43hnN0XOSQSYON7DApnbUI7CMb3+HANI8hZA72BQFliWgUcDWJ6MBHMPUPV+p+meMIC0j9hgBM8w==',key_name='tempest-keypair-77898027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-vis8l380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=38365a85-808f-46c5-a327-53d066e893b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:69:6f,bridge_name='br-int',has_traffic_filtering=True,id=087adeb5-b86e-4577-9c66-6c2e4cc2906c,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087adeb5-b8') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG os_vif [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:69:6f,bridge_name='br-int',has_traffic_filtering=True,id=087adeb5-b86e-4577-9c66-6c2e4cc2906c,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087adeb5-b8') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap087adeb5-b8, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap087adeb5-b8, col_values=(('external_ids', {'iface-id': '087adeb5-b86e-4577-9c66-6c2e4cc2906c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:69:6f', 'vm-uuid': '38365a85-808f-46c5-a327-53d066e893b2'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:55 user nova-compute[82617]: INFO os_vif [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:69:6f,bridge_name='br-int',has_traffic_filtering=True,id=087adeb5-b86e-4577-9c66-6c2e4cc2906c,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087adeb5-b8')
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:58:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] No VIF found with MAC fa:16:3e:f6:69:6f, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:58:56 user nova-compute[82617]: DEBUG nova.network.neutron [req-017a7ebb-e520-44f9-a9b2-f57fc68eaf81 req-2df1b37c-53e4-4683-93fa-e2e9d67e2502 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Updated VIF entry in instance network info cache for port 087adeb5-b86e-4577-9c66-6c2e4cc2906c. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:58:56 user nova-compute[82617]: DEBUG nova.network.neutron [req-017a7ebb-e520-44f9-a9b2-f57fc68eaf81 req-2df1b37c-53e4-4683-93fa-e2e9d67e2502 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Updating instance_info_cache with network_info: [{"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:58:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-017a7ebb-e520-44f9-a9b2-f57fc68eaf81 req-2df1b37c-53e4-4683-93fa-e2e9d67e2502 service nova] Releasing lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-cb74e242-bacb-4671-9593-75169a8f65ef req-768f9424-a846-4ba1-9a46-f10400cc66d8 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received event network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cb74e242-bacb-4671-9593-75169a8f65ef req-768f9424-a846-4ba1-9a46-f10400cc66d8 service nova] Acquiring lock "38365a85-808f-46c5-a327-53d066e893b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cb74e242-bacb-4671-9593-75169a8f65ef req-768f9424-a846-4ba1-9a46-f10400cc66d8 service nova] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cb74e242-bacb-4671-9593-75169a8f65ef req-768f9424-a846-4ba1-9a46-f10400cc66d8 service nova] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-cb74e242-bacb-4671-9593-75169a8f65ef req-768f9424-a846-4ba1-9a46-f10400cc66d8 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] No waiting events found dispatching network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:58:57 user nova-compute[82617]: WARNING nova.compute.manager [req-cb74e242-bacb-4671-9593-75169a8f65ef req-768f9424-a846-4ba1-9a46-f10400cc66d8 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received unexpected event network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c for instance with vm_state building and task_state spawning.
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681747139.1576815, 38365a85-808f-46c5-a327-53d066e893b2 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:58:59 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] VM Resumed (Lifecycle Event)
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:58:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Instance spawned successfully.
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:58:59 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681747139.1590111, 38365a85-808f-46c5-a327-53d066e893b2 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:58:59 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] VM Started (Lifecycle Event)
Apr 17 15:58:59 user nova-compute[82617]: INFO nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Took 5.37 seconds to spawn the instance on the hypervisor.
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:58:59 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-a3a514d2-7217-4419-aa26-552b3aafe83a req-b5f9e593-9eea-472a-8454-aee9cb4607b0 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received event network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a3a514d2-7217-4419-aa26-552b3aafe83a req-b5f9e593-9eea-472a-8454-aee9cb4607b0 service nova] Acquiring lock "38365a85-808f-46c5-a327-53d066e893b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a3a514d2-7217-4419-aa26-552b3aafe83a req-b5f9e593-9eea-472a-8454-aee9cb4607b0 service nova] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-a3a514d2-7217-4419-aa26-552b3aafe83a req-b5f9e593-9eea-472a-8454-aee9cb4607b0 service nova] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:58:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-a3a514d2-7217-4419-aa26-552b3aafe83a req-b5f9e593-9eea-472a-8454-aee9cb4607b0 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] No waiting events found dispatching network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:58:59 user nova-compute[82617]: WARNING nova.compute.manager [req-a3a514d2-7217-4419-aa26-552b3aafe83a req-b5f9e593-9eea-472a-8454-aee9cb4607b0 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received unexpected event network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c for instance with vm_state building and task_state spawning.
Apr 17 15:58:59 user nova-compute[82617]: INFO nova.compute.manager [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Took 6.07 seconds to build instance.
Apr 17 15:58:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ef5ba43d-38a7-4abb-baf6-ec27aa795962 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "38365a85-808f-46c5-a327-53d066e893b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.166s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 15:59:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Skipping network cache update for instance because it is Building. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [{"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d109f8c3-aed3-45af-ba8d-30b9006ef4e4" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:06 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:12 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Verify base images {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Image id b3f0dec1-7758-44a8-82e0-76ada8837428 yields fingerprint eedfa34839e79fc35bb134fcbcf55f7451ef2832 {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 17 15:59:24 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] image b3f0dec1-7758-44a8-82e0-76ada8837428 at (/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832): checking
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] image b3f0dec1-7758-44a8-82e0-76ada8837428 at (/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832): image is in use {{(pid=82617) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Image id 80c527e1-d48e-4a47-a68b-811d385b7db2 yields fingerprint 6082e32daf529637a751c82e6b79b6e611bd90dd {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 17 15:59:24 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] image 80c527e1-d48e-4a47-a68b-811d385b7db2 at (/opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd): checking
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] image 80c527e1-d48e-4a47-a68b-811d385b7db2 at (/opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd): image is in use {{(pid=82617) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] a5d93724-6e77-4b84-8402-812538223cb8 is a valid instance name {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] a5d93724-6e77-4b84-8402-812538223cb8 has a disk file {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance a5d93724-6e77-4b84-8402-812538223cb8 is backed by 6082e32daf529637a751c82e6b79b6e611bd90dd {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] d109f8c3-aed3-45af-ba8d-30b9006ef4e4 is a valid instance name {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] d109f8c3-aed3-45af-ba8d-30b9006ef4e4 has a disk file {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 is backed by eedfa34839e79fc35bb134fcbcf55f7451ef2832 {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] fc3385ee-a569-4a45-812b-b9073d774535 is a valid instance name {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] fc3385ee-a569-4a45-812b-b9073d774535 has a disk file {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 is backed by eedfa34839e79fc35bb134fcbcf55f7451ef2832 {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 is a valid instance name {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 has a disk file {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 is backed by eedfa34839e79fc35bb134fcbcf55f7451ef2832 {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] 38365a85-808f-46c5-a327-53d066e893b2 is a valid instance name {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] 38365a85-808f-46c5-a327-53d066e893b2 has a disk file {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 38365a85-808f-46c5-a327-53d066e893b2 is backed by eedfa34839e79fc35bb134fcbcf55f7451ef2832 {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] 188b31f8-8f5e-41b7-86c5-f0668ea52be7 is a valid instance name {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] 188b31f8-8f5e-41b7-86c5-f0668ea52be7 has a disk file {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 is backed by eedfa34839e79fc35bb134fcbcf55f7451ef2832 {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 15:59:24 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a
Apr 17 15:59:24 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550
Apr 17 15:59:24 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d
Apr 17 15:59:24 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592
Apr 17 15:59:24 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Active base files: /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd
Apr 17 15:59:24 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Removable base files: /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550 /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592
Apr 17 15:59:24 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a
Apr 17 15:59:24 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550
Apr 17 15:59:24 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d
Apr 17 15:59:24 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Verification complete {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Verify swap images {{(pid=82617) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 17 15:59:24 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Verify ephemeral images {{(pid=82617) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 17 15:59:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 15:59:28 user nova-compute[82617]: INFO nova.compute.claims [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Claim successful on node user
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.network.neutron [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 15:59:28 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.policy [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fdc7c80b4654692a52c8a4c4149324f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8586cc10142d4743874f43cdb0f37aba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 15:59:28 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Creating image(s)
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "/opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "/opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk 1073741824" returned: 0 in 0.120s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:28 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.network.neutron [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Successfully created port: 6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Cannot resize image /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.objects.instance [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'migration_context' on Instance uuid d8df4619-5bda-40ff-ab7f-d76ff7e76202 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Ensure instance console log exists: /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.network.neutron [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Successfully updated port: 6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquired lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.network.neutron [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.compute.manager [req-b45d457f-c593-49b9-9e15-1fd8a7901838 req-feeaac48-ecc7-4d2f-8f9d-aa7cce933cf9 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received event network-changed-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.compute.manager [req-b45d457f-c593-49b9-9e15-1fd8a7901838 req-feeaac48-ecc7-4d2f-8f9d-aa7cce933cf9 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Refreshing instance network info cache due to event network-changed-6362d0c1-0446-4dfe-98ad-31529ce77d1a. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b45d457f-c593-49b9-9e15-1fd8a7901838 req-feeaac48-ecc7-4d2f-8f9d-aa7cce933cf9 service nova] Acquiring lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 15:59:29 user nova-compute[82617]: DEBUG nova.network.neutron [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.network.neutron [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updating instance_info_cache with network_info: [{"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Releasing lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Instance network_info: |[{"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b45d457f-c593-49b9-9e15-1fd8a7901838 req-feeaac48-ecc7-4d2f-8f9d-aa7cce933cf9 service nova] Acquired lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.network.neutron [req-b45d457f-c593-49b9-9e15-1fd8a7901838 req-feeaac48-ecc7-4d2f-8f9d-aa7cce933cf9 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Refreshing network info cache for port 6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Start _get_guest_xml network_info=[{"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 15:59:30 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:59:30 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-360792846',display_name='tempest-AttachVolumeNegativeTest-server-360792846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-360792846',id=27,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+K/FkaYgjEBQlN2YNnrc6nwkWCGAicIMP4L/WX4WExAj+mk3c/8v326fy5lSAnyPb8sDKpO9ewLpzo8bWVFXP+ti42DVzQnWYCJ08EoiNZunVZaEV178gCO8wpN05dfg==',key_name='tempest-keypair-911544321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-z6u6tk6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=d8df4619-5bda-40ff-ab7f-d76ff7e76202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:cb,bridge_name='br-int',has_traffic_filtering=True,id=6362d0c1-0446-4dfe-98ad-31529ce77d1a,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362d0c1-04') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.objects.instance [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'pci_devices' on Instance uuid d8df4619-5bda-40ff-ab7f-d76ff7e76202 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] End _get_guest_xml xml=<domain type="kvm">
Apr 17 15:59:30 user nova-compute[82617]:   <uuid>d8df4619-5bda-40ff-ab7f-d76ff7e76202</uuid>
Apr 17 15:59:30 user nova-compute[82617]:   <name>instance-0000001b</name>
Apr 17 15:59:30 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 15:59:30 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 15:59:30 user nova-compute[82617]:   <metadata>
Apr 17 15:59:30 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 15:59:30 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 15:59:30 user nova-compute[82617]:       <nova:name>tempest-AttachVolumeNegativeTest-server-360792846</nova:name>
Apr 17 15:59:30 user nova-compute[82617]:       <nova:creationTime>2023-04-17 15:59:30</nova:creationTime>
Apr 17 15:59:30 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 15:59:30 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 15:59:30 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 15:59:30 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 15:59:30 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 15:59:30 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 15:59:30 user nova-compute[82617]:       </nova:flavor>
Apr 17 15:59:30 user nova-compute[82617]:       <nova:owner>
Apr 17 15:59:30 user nova-compute[82617]:         <nova:user uuid="9fdc7c80b4654692a52c8a4c4149324f">tempest-AttachVolumeNegativeTest-331389537-project-member</nova:user>
Apr 17 15:59:30 user nova-compute[82617]:         <nova:project uuid="8586cc10142d4743874f43cdb0f37aba">tempest-AttachVolumeNegativeTest-331389537</nova:project>
Apr 17 15:59:30 user nova-compute[82617]:       </nova:owner>
Apr 17 15:59:30 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 15:59:30 user nova-compute[82617]:       <nova:ports>
Apr 17 15:59:30 user nova-compute[82617]:         <nova:port uuid="6362d0c1-0446-4dfe-98ad-31529ce77d1a">
Apr 17 15:59:30 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 17 15:59:30 user nova-compute[82617]:         </nova:port>
Apr 17 15:59:30 user nova-compute[82617]:       </nova:ports>
Apr 17 15:59:30 user nova-compute[82617]:     </nova:instance>
Apr 17 15:59:30 user nova-compute[82617]:   </metadata>
Apr 17 15:59:30 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 15:59:30 user nova-compute[82617]:     <system>
Apr 17 15:59:30 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 15:59:30 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 15:59:30 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 15:59:30 user nova-compute[82617]:       <entry name="serial">d8df4619-5bda-40ff-ab7f-d76ff7e76202</entry>
Apr 17 15:59:30 user nova-compute[82617]:       <entry name="uuid">d8df4619-5bda-40ff-ab7f-d76ff7e76202</entry>
Apr 17 15:59:30 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 15:59:30 user nova-compute[82617]:     </system>
Apr 17 15:59:30 user nova-compute[82617]:   </sysinfo>
Apr 17 15:59:30 user nova-compute[82617]:   <os>
Apr 17 15:59:30 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 15:59:30 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 15:59:30 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 15:59:30 user nova-compute[82617]:   </os>
Apr 17 15:59:30 user nova-compute[82617]:   <features>
Apr 17 15:59:30 user nova-compute[82617]:     <acpi/>
Apr 17 15:59:30 user nova-compute[82617]:     <apic/>
Apr 17 15:59:30 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 15:59:30 user nova-compute[82617]:   </features>
Apr 17 15:59:30 user nova-compute[82617]:   <clock offset="utc">
Apr 17 15:59:30 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 15:59:30 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 15:59:30 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 15:59:30 user nova-compute[82617]:   </clock>
Apr 17 15:59:30 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 15:59:30 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 15:59:30 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 15:59:30 user nova-compute[82617]:   </cpu>
Apr 17 15:59:30 user nova-compute[82617]:   <devices>
Apr 17 15:59:30 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 15:59:30 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 15:59:30 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk"/>
Apr 17 15:59:30 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 15:59:30 user nova-compute[82617]:     </disk>
Apr 17 15:59:30 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 15:59:30 user nova-compute[82617]:       <mac address="fa:16:3e:56:bb:cb"/>
Apr 17 15:59:30 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:59:30 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 15:59:30 user nova-compute[82617]:       <target dev="tap6362d0c1-04"/>
Apr 17 15:59:30 user nova-compute[82617]:     </interface>
Apr 17 15:59:30 user nova-compute[82617]:     <serial type="pty">
Apr 17 15:59:30 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/console.log" append="off"/>
Apr 17 15:59:30 user nova-compute[82617]:     </serial>
Apr 17 15:59:30 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 15:59:30 user nova-compute[82617]:     <video>
Apr 17 15:59:30 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 15:59:30 user nova-compute[82617]:     </video>
Apr 17 15:59:30 user nova-compute[82617]:     <rng model="virtio">
Apr 17 15:59:30 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 15:59:30 user nova-compute[82617]:     </rng>
Apr 17 15:59:30 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 15:59:30 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 15:59:30 user nova-compute[82617]:       <stats period="10"/>
Apr 17 15:59:30 user nova-compute[82617]:     </memballoon>
Apr 17 15:59:30 user nova-compute[82617]:   </devices>
Apr 17 15:59:30 user nova-compute[82617]: </domain>
Apr 17 15:59:30 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-360792846',display_name='tempest-AttachVolumeNegativeTest-server-360792846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-360792846',id=27,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+K/FkaYgjEBQlN2YNnrc6nwkWCGAicIMP4L/WX4WExAj+mk3c/8v326fy5lSAnyPb8sDKpO9ewLpzo8bWVFXP+ti42DVzQnWYCJ08EoiNZunVZaEV178gCO8wpN05dfg==',key_name='tempest-keypair-911544321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-z6u6tk6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=d8df4619-5bda-40ff-ab7f-d76ff7e76202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:cb,bridge_name='br-int',has_traffic_filtering=True,id=6362d0c1-0446-4dfe-98ad-31529ce77d1a,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362d0c1-04') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG os_vif [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:cb,bridge_name='br-int',has_traffic_filtering=True,id=6362d0c1-0446-4dfe-98ad-31529ce77d1a,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362d0c1-04') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6362d0c1-04, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6362d0c1-04, col_values=(('external_ids', {'iface-id': '6362d0c1-0446-4dfe-98ad-31529ce77d1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:bb:cb', 'vm-uuid': 'd8df4619-5bda-40ff-ab7f-d76ff7e76202'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:30 user nova-compute[82617]: INFO os_vif [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:cb,bridge_name='br-int',has_traffic_filtering=True,id=6362d0c1-0446-4dfe-98ad-31529ce77d1a,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362d0c1-04')
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] No VIF found with MAC fa:16:3e:56:bb:cb, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.network.neutron [req-b45d457f-c593-49b9-9e15-1fd8a7901838 req-feeaac48-ecc7-4d2f-8f9d-aa7cce933cf9 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updated VIF entry in instance network info cache for port 6362d0c1-0446-4dfe-98ad-31529ce77d1a. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG nova.network.neutron [req-b45d457f-c593-49b9-9e15-1fd8a7901838 req-feeaac48-ecc7-4d2f-8f9d-aa7cce933cf9 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updating instance_info_cache with network_info: [{"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:59:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-b45d457f-c593-49b9-9e15-1fd8a7901838 req-feeaac48-ecc7-4d2f-8f9d-aa7cce933cf9 service nova] Releasing lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 15:59:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-958d1333-af63-4560-89d9-9dc1009130be req-76cad5be-2ab6-44fa-b51b-6e5a5f7d5e8d service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received event network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-958d1333-af63-4560-89d9-9dc1009130be req-76cad5be-2ab6-44fa-b51b-6e5a5f7d5e8d service nova] Acquiring lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-958d1333-af63-4560-89d9-9dc1009130be req-76cad5be-2ab6-44fa-b51b-6e5a5f7d5e8d service nova] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-958d1333-af63-4560-89d9-9dc1009130be req-76cad5be-2ab6-44fa-b51b-6e5a5f7d5e8d service nova] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG nova.compute.manager [req-958d1333-af63-4560-89d9-9dc1009130be req-76cad5be-2ab6-44fa-b51b-6e5a5f7d5e8d service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] No waiting events found dispatching network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:59:32 user nova-compute[82617]: WARNING nova.compute.manager [req-958d1333-af63-4560-89d9-9dc1009130be req-76cad5be-2ab6-44fa-b51b-6e5a5f7d5e8d service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received unexpected event network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a for instance with vm_state building and task_state spawning.
Apr 17 15:59:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681747173.8476932, d8df4619-5bda-40ff-ab7f-d76ff7e76202 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:59:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] VM Resumed (Lifecycle Event)
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 15:59:33 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Instance spawned successfully.
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 15:59:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681747173.8522952, d8df4619-5bda-40ff-ab7f-d76ff7e76202 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:59:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] VM Started (Lifecycle Event)
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 15:59:33 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 15:59:33 user nova-compute[82617]: INFO nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Took 5.42 seconds to spawn the instance on the hypervisor.
Apr 17 15:59:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:59:34 user nova-compute[82617]: INFO nova.compute.manager [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Took 6.12 seconds to build instance.
Apr 17 15:59:34 user nova-compute[82617]: DEBUG nova.compute.manager [req-cc181cc9-cafb-4aa1-bc64-aaa1bfab0038 req-0352e09e-1afb-4564-9317-3db28cfbe9ff service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received event network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:59:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cc181cc9-cafb-4aa1-bc64-aaa1bfab0038 req-0352e09e-1afb-4564-9317-3db28cfbe9ff service nova] Acquiring lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cc181cc9-cafb-4aa1-bc64-aaa1bfab0038 req-0352e09e-1afb-4564-9317-3db28cfbe9ff service nova] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-cc181cc9-cafb-4aa1-bc64-aaa1bfab0038 req-0352e09e-1afb-4564-9317-3db28cfbe9ff service nova] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:34 user nova-compute[82617]: DEBUG nova.compute.manager [req-cc181cc9-cafb-4aa1-bc64-aaa1bfab0038 req-0352e09e-1afb-4564-9317-3db28cfbe9ff service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] No waiting events found dispatching network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:59:34 user nova-compute[82617]: WARNING nova.compute.manager [req-cc181cc9-cafb-4aa1-bc64-aaa1bfab0038 req-0352e09e-1afb-4564-9317-3db28cfbe9ff service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received unexpected event network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a for instance with vm_state active and task_state None.
Apr 17 15:59:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-095d397b-b646-48be-a77d-e7b0a4940ac3 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.218s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "a5d93724-6e77-4b84-8402-812538223cb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "a5d93724-6e77-4b84-8402-812538223cb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "a5d93724-6e77-4b84-8402-812538223cb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:35 user nova-compute[82617]: INFO nova.compute.manager [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Terminating instance
Apr 17 15:59:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:35 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Instance destroyed successfully.
Apr 17 15:59:35 user nova-compute[82617]: DEBUG nova.objects.instance [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lazy-loading 'resources' on Instance uuid a5d93724-6e77-4b84-8402-812538223cb8 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:51:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1535115258',display_name='tempest-TestMinimumBasicScenario-server-1535115258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1535115258',id=22,image_ref='80c527e1-d48e-4a47-a68b-811d385b7db2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBAQHIBaPGb1kijEzJu6HOjYHXu+WJQP8fPmC6jvA7SCQH0c0f+SYm/tjpF0RB5CdQ18IqKShjCStTehJOoThK4X8s1IWwefCquYWDSEaZF0/TZh+S0PXqVjdRETxubzw==',key_name='tempest-TestMinimumBasicScenario-267961014',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:51:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17d1dae0ad7149bbbd160525d64c0c20',ramdisk_id='',reservation_id='r-27bbpirm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80c527e1-d48e-4a47-a68b-811d385b7db2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1774469422',owner_user_name='tempest-TestMinimumBasicScenario-1774469422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:51:18Z,user_data=None,user_id='3c407d9d494d485c9c95dc3981284fba',uuid=a5d93724-6e77-4b84-8402-812538223cb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converting VIF {"id": "26705b2b-0508-4415-bec0-ca247f594d00", "address": "fa:16:3e:d6:94:a9", "network": {"id": "63c86b87-0505-4666-bf70-9e07a29a7be2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2080652867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d1dae0ad7149bbbd160525d64c0c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26705b2b-05", "ovs_interfaceid": "26705b2b-0508-4415-bec0-ca247f594d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:a9,bridge_name='br-int',has_traffic_filtering=True,id=26705b2b-0508-4415-bec0-ca247f594d00,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26705b2b-05') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 15:59:35 user nova-compute[82617]: DEBUG os_vif [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:a9,bridge_name='br-int',has_traffic_filtering=True,id=26705b2b-0508-4415-bec0-ca247f594d00,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26705b2b-05') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26705b2b-05, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:36 user nova-compute[82617]: INFO os_vif [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:a9,bridge_name='br-int',has_traffic_filtering=True,id=26705b2b-0508-4415-bec0-ca247f594d00,network=Network(63c86b87-0505-4666-bf70-9e07a29a7be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26705b2b-05')
Apr 17 15:59:36 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Deleting instance files /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8_del
Apr 17 15:59:36 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Deletion of /opt/stack/data/nova/instances/a5d93724-6e77-4b84-8402-812538223cb8_del complete
Apr 17 15:59:36 user nova-compute[82617]: INFO nova.compute.manager [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: a5d93724-6e77-4b84-8402-812538223cb8] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received event network-vif-unplugged-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] Acquiring lock "a5d93724-6e77-4b84-8402-812538223cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] No waiting events found dispatching network-vif-unplugged-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received event network-vif-unplugged-26705b2b-0508-4415-bec0-ca247f594d00 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received event network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] Acquiring lock "a5d93724-6e77-4b84-8402-812538223cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] Lock "a5d93724-6e77-4b84-8402-812538223cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] No waiting events found dispatching network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 15:59:36 user nova-compute[82617]: WARNING nova.compute.manager [req-224e46fa-8293-48c2-a67c-20b0557c865f req-cd622f34-0a3a-409b-aa82-356061b17af9 service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received unexpected event network-vif-plugged-26705b2b-0508-4415-bec0-ca247f594d00 for instance with vm_state active and task_state deleting.
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:59:36 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Took 0.50 seconds to deallocate network for instance.
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-29d46fe7-b311-4759-a6c4-e90757becab0 req-ab65b5f2-afff-4d93-83d8-59afb4b901ec service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Received event network-vif-deleted-26705b2b-0508-4415-bec0-ca247f594d00 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 15:59:36 user nova-compute[82617]: INFO nova.compute.manager [req-29d46fe7-b311-4759-a6c4-e90757becab0 req-ab65b5f2-afff-4d93-83d8-59afb4b901ec service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Neutron deleted interface 26705b2b-0508-4415-bec0-ca247f594d00; detaching it from the instance and deleting it from the info cache
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.network.neutron [req-29d46fe7-b311-4759-a6c4-e90757becab0 req-ab65b5f2-afff-4d93-83d8-59afb4b901ec service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.manager [req-29d46fe7-b311-4759-a6c4-e90757becab0 req-ab65b5f2-afff-4d93-83d8-59afb4b901ec service nova] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Detach interface failed, port_id=26705b2b-0508-4415-bec0-ca247f594d00, reason: Instance a5d93724-6e77-4b84-8402-812538223cb8 could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:59:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:36 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Deleted allocations for instance a5d93724-6e77-4b84-8402-812538223cb8
Apr 17 15:59:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-cddfa130-27ae-4766-88bb-b720a03e8ce8 tempest-TestMinimumBasicScenario-1774469422 tempest-TestMinimumBasicScenario-1774469422-project-member] Lock "a5d93724-6e77-4b84-8402-812538223cb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.924s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 15:59:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 15:59:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:50 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681747175.976485, a5d93724-6e77-4b84-8402-812538223cb8 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 15:59:50 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: a5d93724-6e77-4b84-8402-812538223cb8] VM Stopped (Lifecycle Event)
Apr 17 15:59:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-124eead0-0520-4d1b-9c53-3f0a2c87ab16 None None] [instance: a5d93724-6e77-4b84-8402-812538223cb8] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 15:59:51 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 15:59:52 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:59:52 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7975MB free_disk=26.007125854492188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 38365a85-808f-46c5-a327-53d066e893b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d8df4619-5bda-40ff-ab7f-d76ff7e76202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 15:59:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 15:59:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 15:59:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:01 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:00:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:05 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:00:06 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:00:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:00:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:00:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:00:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:12 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:12 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:00:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:29 user nova-compute[82617]: WARNING nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Apr 17 16:00:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 188b31f8-8f5e-41b7-86c5-f0668ea52be7 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid f3ff2eef-2305-4c49-8081-aea9a8dfe448 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 38365a85-808f-46c5-a327-53d066e893b2 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid d8df4619-5bda-40ff-ab7f-d76ff7e76202 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "f3ff2eef-2305-4c49-8081-aea9a8dfe448" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "38365a85-808f-46c5-a327-53d066e893b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "38365a85-808f-46c5-a327-53d066e893b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "38365a85-808f-46c5-a327-53d066e893b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:00:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:44 user nova-compute[82617]: DEBUG nova.compute.manager [req-f0c278fc-f7d7-4388-a5d4-469c81cee0af req-ddbdcd89-2724-4085-aba2-e02b3cbf701a service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received event network-changed-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:00:44 user nova-compute[82617]: DEBUG nova.compute.manager [req-f0c278fc-f7d7-4388-a5d4-469c81cee0af req-ddbdcd89-2724-4085-aba2-e02b3cbf701a service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Refreshing instance network info cache due to event network-changed-087adeb5-b86e-4577-9c66-6c2e4cc2906c. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 16:00:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f0c278fc-f7d7-4388-a5d4-469c81cee0af req-ddbdcd89-2724-4085-aba2-e02b3cbf701a service nova] Acquiring lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:00:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f0c278fc-f7d7-4388-a5d4-469c81cee0af req-ddbdcd89-2724-4085-aba2-e02b3cbf701a service nova] Acquired lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:00:44 user nova-compute[82617]: DEBUG nova.network.neutron [req-f0c278fc-f7d7-4388-a5d4-469c81cee0af req-ddbdcd89-2724-4085-aba2-e02b3cbf701a service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Refreshing network info cache for port 087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 16:00:44 user nova-compute[82617]: DEBUG nova.network.neutron [req-f0c278fc-f7d7-4388-a5d4-469c81cee0af req-ddbdcd89-2724-4085-aba2-e02b3cbf701a service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Updated VIF entry in instance network info cache for port 087adeb5-b86e-4577-9c66-6c2e4cc2906c. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 16:00:44 user nova-compute[82617]: DEBUG nova.network.neutron [req-f0c278fc-f7d7-4388-a5d4-469c81cee0af req-ddbdcd89-2724-4085-aba2-e02b3cbf701a service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Updating instance_info_cache with network_info: [{"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:00:44 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-f0c278fc-f7d7-4388-a5d4-469c81cee0af req-ddbdcd89-2724-4085-aba2-e02b3cbf701a service nova] Releasing lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:00:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:52 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:00:53 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:00:54 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:00:54 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8001MB free_disk=26.03194808959961GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 38365a85-808f-46c5-a327-53d066e893b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d8df4619-5bda-40ff-ab7f-d76ff7e76202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:00:54 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:00:55 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:00:55 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:00:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:00:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:00:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:02 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:01:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:01:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:01:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:01:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:01:09 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:01:09 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updating instance_info_cache with network_info: [{"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:01:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-1be3ec86-a922-4c20-94da-d2bbdc70dcd6" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:01:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:01:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:01:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:19 user nova-compute[82617]: DEBUG nova.compute.manager [req-72259510-900f-4587-91b4-820d64765a6f req-554754ef-ab45-4143-86c7-73de1626294f service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received event network-changed-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:01:19 user nova-compute[82617]: DEBUG nova.compute.manager [req-72259510-900f-4587-91b4-820d64765a6f req-554754ef-ab45-4143-86c7-73de1626294f service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Refreshing instance network info cache due to event network-changed-6362d0c1-0446-4dfe-98ad-31529ce77d1a. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 16:01:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-72259510-900f-4587-91b4-820d64765a6f req-554754ef-ab45-4143-86c7-73de1626294f service nova] Acquiring lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:01:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-72259510-900f-4587-91b4-820d64765a6f req-554754ef-ab45-4143-86c7-73de1626294f service nova] Acquired lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:01:19 user nova-compute[82617]: DEBUG nova.network.neutron [req-72259510-900f-4587-91b4-820d64765a6f req-554754ef-ab45-4143-86c7-73de1626294f service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Refreshing network info cache for port 6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 16:01:19 user nova-compute[82617]: DEBUG nova.network.neutron [req-72259510-900f-4587-91b4-820d64765a6f req-554754ef-ab45-4143-86c7-73de1626294f service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updated VIF entry in instance network info cache for port 6362d0c1-0446-4dfe-98ad-31529ce77d1a. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 16:01:19 user nova-compute[82617]: DEBUG nova.network.neutron [req-72259510-900f-4587-91b4-820d64765a6f req-554754ef-ab45-4143-86c7-73de1626294f service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updating instance_info_cache with network_info: [{"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:01:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-72259510-900f-4587-91b4-820d64765a6f req-554754ef-ab45-4143-86c7-73de1626294f service nova] Releasing lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:01:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:34 user nova-compute[82617]: WARNING nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Volume id: 75163b78-31b2-4676-b93b-542a8ea784c1 finished being created but its status is error.
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Instance failed block device setup: nova.exception.VolumeNotCreated: Volume 75163b78-31b2-4676-b93b-542a8ea784c1 did not finish being created even after we waited 419 seconds or 84 attempts. And its status is error.
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Traceback (most recent call last):
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/opt/stack/nova/nova/compute/manager.py", line 2175, in _prep_block_device
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     driver_block_device.attach_block_devices(
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     _log_and_attach(device)
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     bdm.attach(*attach_args, **attach_kwargs)
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/opt/stack/nova/nova/virt/block_device.py", line 831, in attach
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     self.volume_id, self.attachment_id = self._create_volume(
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/opt/stack/nova/nova/virt/block_device.py", line 435, in _create_volume
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     self._call_wait_func(context, wait_func, volume_api, vol['id'])
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/opt/stack/nova/nova/virt/block_device.py", line 785, in _call_wait_func
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     with excutils.save_and_reraise_exception():
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     self.force_reraise()
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     raise self.value
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/opt/stack/nova/nova/virt/block_device.py", line 783, in _call_wait_func
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     wait_func(context, volume_id)
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]   File "/opt/stack/nova/nova/compute/manager.py", line 1792, in _await_block_device_map_created
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448]     raise exception.VolumeNotCreated(volume_id=vol_id,
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] nova.exception.VolumeNotCreated: Volume 75163b78-31b2-4676-b93b-542a8ea784c1 did not finish being created even after we waited 419 seconds or 84 attempts. And its status is error.
Apr 17 16:01:34 user nova-compute[82617]: ERROR nova.compute.manager [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] 
Apr 17 16:01:34 user nova-compute[82617]: DEBUG nova.compute.claims [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Aborting claim: <nova.compute.claims.Claim object at 0x7fd6281e3280> {{(pid=82617) abort /opt/stack/nova/nova/compute/claims.py:84}}
Apr 17 16:01:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:01:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.301s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Build of instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 aborted: Volume 75163b78-31b2-4676-b93b-542a8ea784c1 did not finish being created even after we waited 419 seconds or 84 attempts. And its status is error. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2636}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.compute.utils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Build of instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 aborted: Volume 75163b78-31b2-4676-b93b-542a8ea784c1 did not finish being created even after we waited 419 seconds or 84 attempts. And its status is error. {{(pid=82617) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Apr 17 16:01:35 user nova-compute[82617]: ERROR nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Build of instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 aborted: Volume 75163b78-31b2-4676-b93b-542a8ea784c1 did not finish being created even after we waited 419 seconds or 84 attempts. And its status is error.: nova.exception.BuildAbortException: Build of instance f3ff2eef-2305-4c49-8081-aea9a8dfe448 aborted: Volume 75163b78-31b2-4676-b93b-542a8ea784c1 did not finish being created even after we waited 419 seconds or 84 attempts. And its status is error.
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Unplugging VIFs for instance {{(pid=82617) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2961}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-336081368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-336081368',id=25,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='540826be4baf46dba9617b2fd47821a3',ramdisk_id='',reservation_id='r-4ca0dl1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T15:54:35Z,user_data=None,user_id='d819e3f51368413c99691d1b45bbcfb1',uuid=f3ff2eef-2305-4c49-8081-aea9a8dfe448,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "address": "fa:16:3e:83:3e:b9", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4eadaf2-bb", "ovs_interfaceid": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converting VIF {"id": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "address": "fa:16:3e:83:3e:b9", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4eadaf2-bb", "ovs_interfaceid": "a4eadaf2-bba7-481f-b3b3-c28362f0864f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3e:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4eadaf2-bba7-481f-b3b3-c28362f0864f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4eadaf2-bb') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG os_vif [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3e:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4eadaf2-bba7-481f-b3b3-c28362f0864f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4eadaf2-bb') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4eadaf2-bb, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 16:01:35 user nova-compute[82617]: INFO os_vif [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3e:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4eadaf2-bba7-481f-b3b3-c28362f0864f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4eadaf2-bb')
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Unplugged VIFs for instance {{(pid=82617) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2997}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:35 user nova-compute[82617]: DEBUG nova.network.neutron [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:01:35 user nova-compute[82617]: INFO nova.compute.manager [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] Took 0.61 seconds to deallocate network for instance.
Apr 17 16:01:36 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Deleted allocations for instance f3ff2eef-2305-4c49-8081-aea9a8dfe448
Apr 17 16:01:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-ccaee0c2-d84b-4650-899b-f7362672ce71 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "f3ff2eef-2305-4c49-8081-aea9a8dfe448" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 421.849s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:01:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "f3ff2eef-2305-4c49-8081-aea9a8dfe448" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 66.580s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:01:36 user nova-compute[82617]: INFO nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: f3ff2eef-2305-4c49-8081-aea9a8dfe448] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Apr 17 16:01:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "f3ff2eef-2305-4c49-8081-aea9a8dfe448" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:01:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:01:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:01:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:54 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:01:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:01:56 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:01:56 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=7990MB free_disk=26.019744873046875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 38365a85-808f-46c5-a327-53d066e893b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d8df4619-5bda-40ff-ab7f-d76ff7e76202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:01:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:03 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:02:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:07 user nova-compute[82617]: INFO nova.compute.manager [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Terminating instance
Apr 17 16:02:07 user nova-compute[82617]: DEBUG nova.compute.manager [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:02:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-0eeeb175-6938-4013-8094-cb4412958fd1 req-4ff2616f-92d9-4869-9771-ffd1dceee1b5 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received event network-vif-unplugged-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0eeeb175-6938-4013-8094-cb4412958fd1 req-4ff2616f-92d9-4869-9771-ffd1dceee1b5 service nova] Acquiring lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0eeeb175-6938-4013-8094-cb4412958fd1 req-4ff2616f-92d9-4869-9771-ffd1dceee1b5 service nova] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-0eeeb175-6938-4013-8094-cb4412958fd1 req-4ff2616f-92d9-4869-9771-ffd1dceee1b5 service nova] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-0eeeb175-6938-4013-8094-cb4412958fd1 req-4ff2616f-92d9-4869-9771-ffd1dceee1b5 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] No waiting events found dispatching network-vif-unplugged-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-0eeeb175-6938-4013-8094-cb4412958fd1 req-4ff2616f-92d9-4869-9771-ffd1dceee1b5 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received event network-vif-unplugged-d0d89b4a-1f15-4597-921f-546dc4992df8 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:08 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Instance destroyed successfully.
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.objects.instance [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lazy-loading 'resources' on Instance uuid 188b31f8-8f5e-41b7-86c5-f0668ea52be7 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980352189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980352189',id=23,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='540826be4baf46dba9617b2fd47821a3',ramdisk_id='',reservation_id='r-e6w3b40w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:53:32Z,user_data=None,user_id='d819e3f51368413c99691d1b45bbcfb1',uuid=188b31f8-8f5e-41b7-86c5-f0668ea52be7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converting VIF {"id": "d0d89b4a-1f15-4597-921f-546dc4992df8", "address": "fa:16:3e:96:31:0f", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0d89b4a-1f", "ovs_interfaceid": "d0d89b4a-1f15-4597-921f-546dc4992df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=d0d89b4a-1f15-4597-921f-546dc4992df8,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d89b4a-1f') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG os_vif [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=d0d89b4a-1f15-4597-921f-546dc4992df8,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d89b4a-1f') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0d89b4a-1f, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:08 user nova-compute[82617]: INFO os_vif [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:31:0f,bridge_name='br-int',has_traffic_filtering=True,id=d0d89b4a-1f15-4597-921f-546dc4992df8,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0d89b4a-1f')
Apr 17 16:02:08 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Deleting instance files /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7_del
Apr 17 16:02:08 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Deletion of /opt/stack/data/nova/instances/188b31f8-8f5e-41b7-86c5-f0668ea52be7_del complete
Apr 17 16:02:08 user nova-compute[82617]: INFO nova.compute.manager [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 17 16:02:08 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:02:08 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:02:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:09 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:02:09 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Took 0.87 seconds to deallocate network for instance.
Apr 17 16:02:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:09 user nova-compute[82617]: DEBUG nova.compute.manager [req-a48beabc-9dcc-4419-bd2c-46ba5024924e req-2f8c8395-b923-4f68-9f7f-5fa8c65b703b service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received event network-vif-deleted-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:02:09 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:02:09 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:02:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:09 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Deleted allocations for instance 188b31f8-8f5e-41b7-86c5-f0668ea52be7
Apr 17 16:02:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-39284c6c-2d42-4f32-b6d1-efc93a861165 tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-73c47350-d376-4076-ae71-2f780b0a6f0e req-9b8da74b-1909-4612-85ce-ac7723f1eec9 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received event network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-73c47350-d376-4076-ae71-2f780b0a6f0e req-9b8da74b-1909-4612-85ce-ac7723f1eec9 service nova] Acquiring lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-73c47350-d376-4076-ae71-2f780b0a6f0e req-9b8da74b-1909-4612-85ce-ac7723f1eec9 service nova] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-73c47350-d376-4076-ae71-2f780b0a6f0e req-9b8da74b-1909-4612-85ce-ac7723f1eec9 service nova] Lock "188b31f8-8f5e-41b7-86c5-f0668ea52be7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-73c47350-d376-4076-ae71-2f780b0a6f0e req-9b8da74b-1909-4612-85ce-ac7723f1eec9 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] No waiting events found dispatching network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:02:10 user nova-compute[82617]: WARNING nova.compute.manager [req-73c47350-d376-4076-ae71-2f780b0a6f0e req-9b8da74b-1909-4612-85ce-ac7723f1eec9 service nova] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Received unexpected event network-vif-plugged-d0d89b4a-1f15-4597-921f-546dc4992df8 for instance with vm_state deleted and task_state None.
Apr 17 16:02:10 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Updating instance_info_cache with network_info: [{"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-38365a85-808f-46c5-a327-53d066e893b2" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:02:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:02:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:15 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:23 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681747328.3982408, 188b31f8-8f5e-41b7-86c5-f0668ea52be7 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:02:23 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] VM Stopped (Lifecycle Event)
Apr 17 16:02:23 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ea853a2-07ae-4ae3-bd6b-783e73c3f615 None None] [instance: 188b31f8-8f5e-41b7-86c5-f0668ea52be7] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:02:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:02:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:02:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:02:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:02:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:02:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:02:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:54 user nova-compute[82617]: INFO nova.compute.manager [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Terminating instance
Apr 17 16:02:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-deecd07f-0f4d-4c01-9585-de9e39677d5a req-d7cddc12-20b0-44d9-b58b-9f4775b8f832 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-unplugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-deecd07f-0f4d-4c01-9585-de9e39677d5a req-d7cddc12-20b0-44d9-b58b-9f4775b8f832 service nova] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-deecd07f-0f4d-4c01-9585-de9e39677d5a req-d7cddc12-20b0-44d9-b58b-9f4775b8f832 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-deecd07f-0f4d-4c01-9585-de9e39677d5a req-d7cddc12-20b0-44d9-b58b-9f4775b8f832 service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-deecd07f-0f4d-4c01-9585-de9e39677d5a req-d7cddc12-20b0-44d9-b58b-9f4775b8f832 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] No waiting events found dispatching network-vif-unplugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:02:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-deecd07f-0f4d-4c01-9585-de9e39677d5a req-d7cddc12-20b0-44d9-b58b-9f4775b8f832 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-unplugged-3318391f-7474-432a-ab24-5eec02673b8b for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 16:02:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Instance destroyed successfully.
Apr 17 16:02:55 user nova-compute[82617]: DEBUG nova.objects.instance [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lazy-loading 'resources' on Instance uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-17T15:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1046525286',display_name='tempest-ServerActionsTestJSON-server-1900644062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1046525286',id=2,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF/iT/MoNqI4mhGgg4bOPeUaFmt+HKbeuQKnHdTMDQH/HNrNLZzsK9yPUW4qjOgGc4Pp1VwczdJXHNBz2a1NYZg13VzE5dIV1MKrnPYhhBkxvkUIIsFdmTFbdFLrQg4nw==',key_name='tempest-keypair-200176256',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:28:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb5f6b5ed2fc43b69c47e1fc18646545',ramdisk_id='',reservation_id='r-d8m8mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-645547919',owner_user_name='tempest-ServerActionsTestJSON-645547919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='638a4f535e9740fc9d810639a5eb24d7',uuid=d109f8c3-aed3-45af-ba8d-30b9006ef4e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converting VIF {"id": "3318391f-7474-432a-ab24-5eec02673b8b", "address": "fa:16:3e:26:9b:4e", "network": {"id": "278daca2-2fcf-44d8-8a54-b89a39eaaa3f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-303738415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb5f6b5ed2fc43b69c47e1fc18646545", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3318391f-74", "ovs_interfaceid": "3318391f-7474-432a-ab24-5eec02673b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_vif [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3318391f-74, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:55 user nova-compute[82617]: INFO os_vif [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:9b:4e,bridge_name='br-int',has_traffic_filtering=True,id=3318391f-7474-432a-ab24-5eec02673b8b,network=Network(278daca2-2fcf-44d8-8a54-b89a39eaaa3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3318391f-74')
Apr 17 16:02:55 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKISaVyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 16:02:55 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[68446db2-5afa-4558-808f-0b033b258136]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 16:02:55 user nova-compute[82617]: No targets found.
Apr 17 16:02:55 user nova-compute[82617]: iSNS:
Apr 17 16:02:55 user nova-compute[82617]: No targets found.
Apr 17 16:02:55 user nova-compute[82617]: STATIC:
Apr 17 16:02:55 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9
Apr 17 16:02:55 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 16:02:55 user nova-compute[82617]:                 Iface Name: default
Apr 17 16:02:55 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214
Apr 17 16:02:55 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 16:02:55 user nova-compute[82617]:                 Iface Name: default
Apr 17 16:02:55 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911
Apr 17 16:02:55 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 16:02:55 user nova-compute[82617]:                 Iface Name: default
Apr 17 16:02:55 user nova-compute[82617]: FIRMWARE:
Apr 17 16:02:55 user nova-compute[82617]: No targets found.
Apr 17 16:02:55 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 16:02:55 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 16:02:55 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[01324ad4-1d50-4cce-b5c8-ae90eb88bd0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11864fb-7c0b-44ca-a797-a83d2b4035ca]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 16:02:55 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 16:02:55 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 16:02:55 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 16:02:55 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 16:02:55 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 16:02:55 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64906d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9'): ({'sdc'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Removing single pathed devices sdc {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36e9fc9-9a8c-481e-856a-a55f4c77a78a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 1 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd4c37-2bf2-49ff-9607-9273f3fbacfe]: (4, ('fail\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flushing IO for device /dev/sdc {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 1 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdc' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:55 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 20 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-7c0a560e-4c21-4b68-af18-9b436eb6fe7b req-a4d234d1-1417-4d28-8fe2-2a8e4bfebb1e service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7c0a560e-4c21-4b68-af18-9b436eb6fe7b req-a4d234d1-1417-4d28-8fe2-2a8e4bfebb1e service nova] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7c0a560e-4c21-4b68-af18-9b436eb6fe7b req-a4d234d1-1417-4d28-8fe2-2a8e4bfebb1e service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7c0a560e-4c21-4b68-af18-9b436eb6fe7b req-a4d234d1-1417-4d28-8fe2-2a8e4bfebb1e service nova] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-7c0a560e-4c21-4b68-af18-9b436eb6fe7b req-a4d234d1-1417-4d28-8fe2-2a8e4bfebb1e service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] No waiting events found dispatching network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:02:56 user nova-compute[82617]: WARNING nova.compute.manager [req-7c0a560e-4c21-4b68-af18-9b436eb6fe7b req-a4d234d1-1417-4d28-8fe2-2a8e4bfebb1e service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received unexpected event network-vif-plugged-3318391f-7474-432a-ab24-5eec02673b8b for instance with vm_state active and task_state deleting.
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:02:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:02:58 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:02:58 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8092MB free_disk=26.07183074951172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 38365a85-808f-46c5-a327-53d066e893b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d8df4619-5bda-40ff-ab7f-d76ff7e76202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:58 user nova-compute[82617]: INFO nova.compute.manager [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Terminating instance
Apr 17 16:02:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-5a28898a-575c-49d4-afc3-7275ecf9c455 req-c51a08e4-e5b7-43e0-a3b6-138ae6c4a624 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received event network-vif-unplugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5a28898a-575c-49d4-afc3-7275ecf9c455 req-c51a08e4-e5b7-43e0-a3b6-138ae6c4a624 service nova] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5a28898a-575c-49d4-afc3-7275ecf9c455 req-c51a08e4-e5b7-43e0-a3b6-138ae6c4a624 service nova] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-5a28898a-575c-49d4-afc3-7275ecf9c455 req-c51a08e4-e5b7-43e0-a3b6-138ae6c4a624 service nova] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-5a28898a-575c-49d4-afc3-7275ecf9c455 req-c51a08e4-e5b7-43e0-a3b6-138ae6c4a624 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] No waiting events found dispatching network-vif-unplugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.compute.manager [req-5a28898a-575c-49d4-afc3-7275ecf9c455 req-c51a08e4-e5b7-43e0-a3b6-138ae6c4a624 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received event network-vif-unplugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 16:02:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Instance destroyed successfully.
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.objects.instance [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lazy-loading 'resources' on Instance uuid 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2021873803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2021873803',id=18,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:41:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='540826be4baf46dba9617b2fd47821a3',ramdisk_id='',reservation_id='r-u2ewglfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:43:00Z,user_data=None,user_id='d819e3f51368413c99691d1b45bbcfb1',uuid=1be3ec86-a922-4c20-94da-d2bbdc70dcd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converting VIF {"id": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "address": "fa:16:3e:04:b5:bc", "network": {"id": "6da0c7a2-54b4-4a5f-9167-a5490db7bd53", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-313048307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "540826be4baf46dba9617b2fd47821a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5384bf0b-76", "ovs_interfaceid": "5384bf0b-7657-4d2f-b395-c76db88f5f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5384bf0b-7657-4d2f-b395-c76db88f5f6f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5384bf0b-76') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG os_vif [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5384bf0b-7657-4d2f-b395-c76db88f5f6f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5384bf0b-76') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5384bf0b-76, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:59 user nova-compute[82617]: INFO os_vif [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5384bf0b-7657-4d2f-b395-c76db88f5f6f,network=Network(6da0c7a2-54b4-4a5f-9167-a5490db7bd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5384bf0b-76')
Apr 17 16:02:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Deleting instance files /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6_del
Apr 17 16:02:59 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Deletion of /opt/stack/data/nova/instances/1be3ec86-a922-4c20-94da-d2bbdc70dcd6_del complete
Apr 17 16:02:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:02:59 user nova-compute[82617]: INFO nova.compute.manager [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 17 16:02:59 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:02:59 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Took 0.46 seconds to deallocate network for instance.
Apr 17 16:02:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:02:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:03:00 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:03:00 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:03:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:03:00 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Deleted allocations for instance 1be3ec86-a922-4c20-94da-d2bbdc70dcd6
Apr 17 16:03:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-da03384d-581c-4a78-bbad-9b2ad5c22b3c tempest-ServerBootFromVolumeStableRescueTest-1271370980 tempest-ServerBootFromVolumeStableRescueTest-1271370980-project-member] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.531s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:03:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-495ec630-21ea-480e-9e4a-79d34c380d5b req-864718a8-98e3-41e8-a795-d3882d5a7a72 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received event network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:03:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-495ec630-21ea-480e-9e4a-79d34c380d5b req-864718a8-98e3-41e8-a795-d3882d5a7a72 service nova] Acquiring lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:03:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-495ec630-21ea-480e-9e4a-79d34c380d5b req-864718a8-98e3-41e8-a795-d3882d5a7a72 service nova] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:03:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-495ec630-21ea-480e-9e4a-79d34c380d5b req-864718a8-98e3-41e8-a795-d3882d5a7a72 service nova] Lock "1be3ec86-a922-4c20-94da-d2bbdc70dcd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:03:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-495ec630-21ea-480e-9e4a-79d34c380d5b req-864718a8-98e3-41e8-a795-d3882d5a7a72 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] No waiting events found dispatching network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:03:01 user nova-compute[82617]: WARNING nova.compute.manager [req-495ec630-21ea-480e-9e4a-79d34c380d5b req-864718a8-98e3-41e8-a795-d3882d5a7a72 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received unexpected event network-vif-plugged-5384bf0b-7657-4d2f-b395-c76db88f5f6f for instance with vm_state deleted and task_state None.
Apr 17 16:03:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-495ec630-21ea-480e-9e4a-79d34c380d5b req-864718a8-98e3-41e8-a795-d3882d5a7a72 service nova] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Received event network-vif-deleted-5384bf0b-7657-4d2f-b395-c76db88f5f6f {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:03:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:03:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:03:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:03:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:03:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:03:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681747375.0814624, d109f8c3-aed3-45af-ba8d-30b9006ef4e4 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:03:10 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] VM Stopped (Lifecycle Event)
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-5ca73b76-c8b9-4ab0-b4d7-6f4d0eaefa67 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-5ca73b76-c8b9-4ab0-b4d7-6f4d0eaefa67 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:03:10 user nova-compute[82617]: INFO nova.compute.manager [None req-5ca73b76-c8b9-4ab0-b4d7-6f4d0eaefa67 None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:03:10 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:03:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:14 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681747379.2121038, 1be3ec86-a922-4c20-94da-d2bbdc70dcd6 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:03:14 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] VM Stopped (Lifecycle Event)
Apr 17 16:03:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-57bd2608-4f7a-4d77-a4c2-0cb3ce447be1 None None] [instance: 1be3ec86-a922-4c20-94da-d2bbdc70dcd6] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:03:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 1 in 20.033s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:03:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdc' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 16:03:15 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:03:15 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 40 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 16:03:16 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:03:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:03:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:03:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:03:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:03:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:50 user nova-compute[82617]: INFO nova.compute.manager [None req-f29d1988-1f2e-4a0a-bb7d-9b90bcf9debf tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Get console output
Apr 17 16:03:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 1 in 40.047s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:03:55 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdc' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 16:03:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b3adf663-f146-4604-a155-b6349d9beafb]: Unexpected error while running command.
Apr 17 16:03:55 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdc
Apr 17 16:03:55 user nova-compute[82617]: Exit code: 1
Apr 17 16:03:55 user nova-compute[82617]: Stdout: ''
Apr 17 16:03:55 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n' {{(pid=92892) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 17 16:03:55 user nova-compute[82617]: Traceback (most recent call last):
Apr 17 16:03:55 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 17 16:03:55 user nova-compute[82617]:     ret = func(*f_args, **f_kwargs)
Apr 17 16:03:55 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 17 16:03:55 user nova-compute[82617]:     return func(*args, **kwargs)
Apr 17 16:03:55 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 17 16:03:55 user nova-compute[82617]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 17 16:03:55 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 17 16:03:55 user nova-compute[82617]:     return putils.execute(on_execute=on_execute,
Apr 17 16:03:55 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 17 16:03:55 user nova-compute[82617]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 17 16:03:55 user nova-compute[82617]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 16:03:55 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdc
Apr 17 16:03:55 user nova-compute[82617]: Exit code: 1
Apr 17 16:03:55 user nova-compute[82617]: Stdout: ''
Apr 17 16:03:55 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n'
Apr 17 16:03:55 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3adf663-f146-4604-a155-b6349d9beafb]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('', 'blockdev: cannot open /dev/sdc: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdc', None)) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:03:55 user nova-compute[82617]: WARNING os_brick.initiator.linuxscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Failed to flush IO buffers prior to removing device: 1: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 16:03:55 user nova-compute[82617]: WARNING os_brick.exception [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Flushing /dev/sdc failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 16:03:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.232s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 16:03:55 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] <== disconnect_volume: exception (60233ms) ProcessExecutionError('', 'blockdev: cannot open /dev/sdc: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdc', None) {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:188}}
Apr 17 16:03:55 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Ignoring Volume Error on vol 1072d05f-2ebb-4398-902c-902df25464e9 during delete Unexpected error while running command.
Apr 17 16:03:55 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdc
Apr 17 16:03:55 user nova-compute[82617]: Exit code: 1
Apr 17 16:03:55 user nova-compute[82617]: Stdout: ''
Apr 17 16:03:55 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdc: No such device or address\n': oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 16:03:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Deleting instance files /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4_del
Apr 17 16:03:55 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Deletion of /opt/stack/data/nova/instances/d109f8c3-aed3-45af-ba8d-30b9006ef4e4_del complete
Apr 17 16:03:55 user nova-compute[82617]: INFO nova.compute.manager [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Took 61.08 seconds to destroy the instance on the hypervisor.
Apr 17 16:03:55 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:03:55 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:03:55 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:03:56 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Took 0.84 seconds to deallocate network for instance.
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG nova.compute.manager [req-032d05e9-5a34-42ba-9b89-fac86447f1a1 req-49e52ec4-2d7c-4341-a449-43af13e36a37 service nova] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Received event network-vif-deleted-3318391f-7474-432a-ab24-5eec02673b8b {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:03:56 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:03:57 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:03:57 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8242MB free_disk=26.13482666015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 38365a85-808f-46c5-a327-53d066e893b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d8df4619-5bda-40ff-ab7f-d76ff7e76202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:03:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:03:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:03:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "38365a85-808f-46c5-a327-53d066e893b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "38365a85-808f-46c5-a327-53d066e893b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "38365a85-808f-46c5-a327-53d066e893b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:00 user nova-compute[82617]: INFO nova.compute.manager [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Terminating instance
Apr 17 16:04:00 user nova-compute[82617]: DEBUG nova.compute.manager [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-9346a72b-0eff-4367-ae9c-6c1327a2b1e1 req-a28ae7bf-864d-4839-8a0a-62168a443117 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received event network-vif-unplugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9346a72b-0eff-4367-ae9c-6c1327a2b1e1 req-a28ae7bf-864d-4839-8a0a-62168a443117 service nova] Acquiring lock "38365a85-808f-46c5-a327-53d066e893b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9346a72b-0eff-4367-ae9c-6c1327a2b1e1 req-a28ae7bf-864d-4839-8a0a-62168a443117 service nova] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9346a72b-0eff-4367-ae9c-6c1327a2b1e1 req-a28ae7bf-864d-4839-8a0a-62168a443117 service nova] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-9346a72b-0eff-4367-ae9c-6c1327a2b1e1 req-a28ae7bf-864d-4839-8a0a-62168a443117 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] No waiting events found dispatching network-vif-unplugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG nova.compute.manager [req-9346a72b-0eff-4367-ae9c-6c1327a2b1e1 req-a28ae7bf-864d-4839-8a0a-62168a443117 service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received event network-vif-unplugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 16:04:00 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Instance destroyed successfully.
Apr 17 16:04:00 user nova-compute[82617]: DEBUG nova.objects.instance [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lazy-loading 'resources' on Instance uuid 38365a85-808f-46c5-a327-53d066e893b2 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-190485391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-190485391',id=26,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLUDO5kr+TzN9QSRVENAgbTi002Im2KRK4Z00OTSPxRKMe64Q+U+t43hnN0XOSQSYON7DApnbUI7CMb3+HANI8hZA72BQFliWgUcDWJ6MBHMPUPV+p+meMIC0j9hgBM8w==',key_name='tempest-keypair-77898027',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:58:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='214a0f233f114d7aa22e64048a837c0b',ramdisk_id='',reservation_id='r-vis8l380',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1745617049',owner_user_name='tempest-AttachVolumeShelveTestJSON-1745617049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83b9d77de46143d8b9277a55f5ad4d72',uuid=38365a85-808f-46c5-a327-53d066e893b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converting VIF {"id": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "address": "fa:16:3e:f6:69:6f", "network": {"id": "5d14c708-5e21-4e26-ada7-b48255c1b360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-724811271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "214a0f233f114d7aa22e64048a837c0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087adeb5-b8", "ovs_interfaceid": "087adeb5-b86e-4577-9c66-6c2e4cc2906c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:69:6f,bridge_name='br-int',has_traffic_filtering=True,id=087adeb5-b86e-4577-9c66-6c2e4cc2906c,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087adeb5-b8') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG os_vif [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:69:6f,bridge_name='br-int',has_traffic_filtering=True,id=087adeb5-b86e-4577-9c66-6c2e4cc2906c,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087adeb5-b8') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap087adeb5-b8, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:04:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:00 user nova-compute[82617]: INFO os_vif [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:69:6f,bridge_name='br-int',has_traffic_filtering=True,id=087adeb5-b86e-4577-9c66-6c2e4cc2906c,network=Network(5d14c708-5e21-4e26-ada7-b48255c1b360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087adeb5-b8')
Apr 17 16:04:00 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Deleting instance files /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2_del
Apr 17 16:04:00 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Deletion of /opt/stack/data/nova/instances/38365a85-808f-46c5-a327-53d066e893b2_del complete
Apr 17 16:04:01 user nova-compute[82617]: INFO nova.compute.manager [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 17 16:04:01 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:04:01 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:04:01 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 38365a85-808f-46c5-a327-53d066e893b2] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:04:01 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:04:01 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Took 0.80 seconds to deallocate network for instance.
Apr 17 16:04:01 user nova-compute[82617]: DEBUG nova.compute.manager [req-3c1ae459-3480-47fd-943a-56229230516e req-f66a94b1-2fe9-4e60-90d3-336587a9fe0d service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received event network-vif-deleted-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:02 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Deleted allocations for instance 38365a85-808f-46c5-a327-53d066e893b2
Apr 17 16:04:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-02818945-f44a-4d9c-83e2-f2f9db132207 tempest-AttachVolumeShelveTestJSON-1745617049 tempest-AttachVolumeShelveTestJSON-1745617049-project-member] Lock "38365a85-808f-46c5-a327-53d066e893b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.830s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG nova.compute.manager [req-3975cf5a-c4a0-4169-a0d8-1d901ddd673a req-92043140-5e83-46a8-8ec1-97c236bf8b0a service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received event network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3975cf5a-c4a0-4169-a0d8-1d901ddd673a req-92043140-5e83-46a8-8ec1-97c236bf8b0a service nova] Acquiring lock "38365a85-808f-46c5-a327-53d066e893b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3975cf5a-c4a0-4169-a0d8-1d901ddd673a req-92043140-5e83-46a8-8ec1-97c236bf8b0a service nova] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-3975cf5a-c4a0-4169-a0d8-1d901ddd673a req-92043140-5e83-46a8-8ec1-97c236bf8b0a service nova] Lock "38365a85-808f-46c5-a327-53d066e893b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:02 user nova-compute[82617]: DEBUG nova.compute.manager [req-3975cf5a-c4a0-4169-a0d8-1d901ddd673a req-92043140-5e83-46a8-8ec1-97c236bf8b0a service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] No waiting events found dispatching network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:04:02 user nova-compute[82617]: WARNING nova.compute.manager [req-3975cf5a-c4a0-4169-a0d8-1d901ddd673a req-92043140-5e83-46a8-8ec1-97c236bf8b0a service nova] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Received unexpected event network-vif-plugged-087adeb5-b86e-4577-9c66-6c2e4cc2906c for instance with vm_state deleted and task_state None.
Apr 17 16:04:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "90f923a6-7f37-44c9-aacf-1d15aff0af63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:03 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 16:04:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:03 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 16:04:03 user nova-compute[82617]: INFO nova.compute.claims [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Claim successful on node user
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 16:04:04 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.policy [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9d4a317838b47d6a2a2e7eab7a453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb998c84b5b41e599af9636b929295d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 16:04:04 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Creating image(s)
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "/opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "/opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "/opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk 1073741824" returned: 0 in 0.051s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Successfully created port: 13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Cannot resize image /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lazy-loading 'migration_context' on Instance uuid 90f923a6-7f37-44c9-aacf-1d15aff0af63 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Ensure instance console log exists: /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Successfully updated port: 13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquired lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.compute.manager [req-443a9912-baa1-40a2-9a39-aeff875e17ba req-f8f217c9-6228-474e-98c5-e4f828dd09aa service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received event network-changed-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.compute.manager [req-443a9912-baa1-40a2-9a39-aeff875e17ba req-f8f217c9-6228-474e-98c5-e4f828dd09aa service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Refreshing instance network info cache due to event network-changed-13859f03-8c8c-4f84-8de0-3126989f4cde. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-443a9912-baa1-40a2-9a39-aeff875e17ba req-f8f217c9-6228-474e-98c5-e4f828dd09aa service nova] Acquiring lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:04:05 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updating instance_info_cache with network_info: [{"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Releasing lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Instance network_info: |[{"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-443a9912-baa1-40a2-9a39-aeff875e17ba req-f8f217c9-6228-474e-98c5-e4f828dd09aa service nova] Acquired lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-443a9912-baa1-40a2-9a39-aeff875e17ba req-f8f217c9-6228-474e-98c5-e4f828dd09aa service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Refreshing network info cache for port 13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Start _get_guest_xml network_info=[{"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 16:04:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:04:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1343390848',display_name='tempest-AttachVolumeTestJSON-server-1343390848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1343390848',id=28,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZDRHFLc5GDg1Ipp9BWhdjmE4gVjyAH89nS8xe4jSsCGN/gzX8ygBw+cM2bfVcDbURrjFfMGidK7X8fc/EymaND4LhBjs3W8Gs0RC43DltkXT1bPMCHVm+SGH7nWpsC6g==',key_name='tempest-keypair-888711113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eb998c84b5b41e599af9636b929295d',ramdisk_id='',reservation_id='r-pl4az9rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1193954556',owner_user_name='tempest-AttachVolumeTestJSON-1193954556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T16:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d4a317838b47d6a2a2e7eab7a453dd',uuid=90f923a6-7f37-44c9-aacf-1d15aff0af63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converting VIF {"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=13859f03-8c8c-4f84-8de0-3126989f4cde,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13859f03-8c') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lazy-loading 'pci_devices' on Instance uuid 90f923a6-7f37-44c9-aacf-1d15aff0af63 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] End _get_guest_xml xml=<domain type="kvm">
Apr 17 16:04:06 user nova-compute[82617]:   <uuid>90f923a6-7f37-44c9-aacf-1d15aff0af63</uuid>
Apr 17 16:04:06 user nova-compute[82617]:   <name>instance-0000001c</name>
Apr 17 16:04:06 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 16:04:06 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 16:04:06 user nova-compute[82617]:   <metadata>
Apr 17 16:04:06 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 16:04:06 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 16:04:06 user nova-compute[82617]:       <nova:name>tempest-AttachVolumeTestJSON-server-1343390848</nova:name>
Apr 17 16:04:06 user nova-compute[82617]:       <nova:creationTime>2023-04-17 16:04:06</nova:creationTime>
Apr 17 16:04:06 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 16:04:06 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 16:04:06 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 16:04:06 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 16:04:06 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 16:04:06 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 16:04:06 user nova-compute[82617]:       </nova:flavor>
Apr 17 16:04:06 user nova-compute[82617]:       <nova:owner>
Apr 17 16:04:06 user nova-compute[82617]:         <nova:user uuid="b9d4a317838b47d6a2a2e7eab7a453dd">tempest-AttachVolumeTestJSON-1193954556-project-member</nova:user>
Apr 17 16:04:06 user nova-compute[82617]:         <nova:project uuid="2eb998c84b5b41e599af9636b929295d">tempest-AttachVolumeTestJSON-1193954556</nova:project>
Apr 17 16:04:06 user nova-compute[82617]:       </nova:owner>
Apr 17 16:04:06 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 16:04:06 user nova-compute[82617]:       <nova:ports>
Apr 17 16:04:06 user nova-compute[82617]:         <nova:port uuid="13859f03-8c8c-4f84-8de0-3126989f4cde">
Apr 17 16:04:06 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 16:04:06 user nova-compute[82617]:         </nova:port>
Apr 17 16:04:06 user nova-compute[82617]:       </nova:ports>
Apr 17 16:04:06 user nova-compute[82617]:     </nova:instance>
Apr 17 16:04:06 user nova-compute[82617]:   </metadata>
Apr 17 16:04:06 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 16:04:06 user nova-compute[82617]:     <system>
Apr 17 16:04:06 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 16:04:06 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 16:04:06 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 16:04:06 user nova-compute[82617]:       <entry name="serial">90f923a6-7f37-44c9-aacf-1d15aff0af63</entry>
Apr 17 16:04:06 user nova-compute[82617]:       <entry name="uuid">90f923a6-7f37-44c9-aacf-1d15aff0af63</entry>
Apr 17 16:04:06 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 16:04:06 user nova-compute[82617]:     </system>
Apr 17 16:04:06 user nova-compute[82617]:   </sysinfo>
Apr 17 16:04:06 user nova-compute[82617]:   <os>
Apr 17 16:04:06 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 16:04:06 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 16:04:06 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 16:04:06 user nova-compute[82617]:   </os>
Apr 17 16:04:06 user nova-compute[82617]:   <features>
Apr 17 16:04:06 user nova-compute[82617]:     <acpi/>
Apr 17 16:04:06 user nova-compute[82617]:     <apic/>
Apr 17 16:04:06 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 16:04:06 user nova-compute[82617]:   </features>
Apr 17 16:04:06 user nova-compute[82617]:   <clock offset="utc">
Apr 17 16:04:06 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 16:04:06 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 16:04:06 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 16:04:06 user nova-compute[82617]:   </clock>
Apr 17 16:04:06 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 16:04:06 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 16:04:06 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 16:04:06 user nova-compute[82617]:   </cpu>
Apr 17 16:04:06 user nova-compute[82617]:   <devices>
Apr 17 16:04:06 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 16:04:06 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 16:04:06 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk"/>
Apr 17 16:04:06 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 16:04:06 user nova-compute[82617]:     </disk>
Apr 17 16:04:06 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 16:04:06 user nova-compute[82617]:       <mac address="fa:16:3e:a5:c4:5a"/>
Apr 17 16:04:06 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 16:04:06 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 16:04:06 user nova-compute[82617]:       <target dev="tap13859f03-8c"/>
Apr 17 16:04:06 user nova-compute[82617]:     </interface>
Apr 17 16:04:06 user nova-compute[82617]:     <serial type="pty">
Apr 17 16:04:06 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/console.log" append="off"/>
Apr 17 16:04:06 user nova-compute[82617]:     </serial>
Apr 17 16:04:06 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 16:04:06 user nova-compute[82617]:     <video>
Apr 17 16:04:06 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 16:04:06 user nova-compute[82617]:     </video>
Apr 17 16:04:06 user nova-compute[82617]:     <rng model="virtio">
Apr 17 16:04:06 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 16:04:06 user nova-compute[82617]:     </rng>
Apr 17 16:04:06 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 16:04:06 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 16:04:06 user nova-compute[82617]:       <stats period="10"/>
Apr 17 16:04:06 user nova-compute[82617]:     </memballoon>
Apr 17 16:04:06 user nova-compute[82617]:   </devices>
Apr 17 16:04:06 user nova-compute[82617]: </domain>
Apr 17 16:04:06 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1343390848',display_name='tempest-AttachVolumeTestJSON-server-1343390848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1343390848',id=28,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZDRHFLc5GDg1Ipp9BWhdjmE4gVjyAH89nS8xe4jSsCGN/gzX8ygBw+cM2bfVcDbURrjFfMGidK7X8fc/EymaND4LhBjs3W8Gs0RC43DltkXT1bPMCHVm+SGH7nWpsC6g==',key_name='tempest-keypair-888711113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eb998c84b5b41e599af9636b929295d',ramdisk_id='',reservation_id='r-pl4az9rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1193954556',owner_user_name='tempest-AttachVolumeTestJSON-1193954556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T16:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d4a317838b47d6a2a2e7eab7a453dd',uuid=90f923a6-7f37-44c9-aacf-1d15aff0af63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converting VIF {"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=13859f03-8c8c-4f84-8de0-3126989f4cde,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13859f03-8c') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG os_vif [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=13859f03-8c8c-4f84-8de0-3126989f4cde,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13859f03-8c') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13859f03-8c, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13859f03-8c, col_values=(('external_ids', {'iface-id': '13859f03-8c8c-4f84-8de0-3126989f4cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:c4:5a', 'vm-uuid': '90f923a6-7f37-44c9-aacf-1d15aff0af63'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:06 user nova-compute[82617]: INFO os_vif [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=13859f03-8c8c-4f84-8de0-3126989f4cde,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13859f03-8c')
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] No VIF found with MAC fa:16:3e:a5:c4:5a, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-443a9912-baa1-40a2-9a39-aeff875e17ba req-f8f217c9-6228-474e-98c5-e4f828dd09aa service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updated VIF entry in instance network info cache for port 13859f03-8c8c-4f84-8de0-3126989f4cde. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG nova.network.neutron [req-443a9912-baa1-40a2-9a39-aeff875e17ba req-f8f217c9-6228-474e-98c5-e4f828dd09aa service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updating instance_info_cache with network_info: [{"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:04:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-443a9912-baa1-40a2-9a39-aeff875e17ba req-f8f217c9-6228-474e-98c5-e4f828dd09aa service nova] Releasing lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:04:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-8aceec4c-2ca8-4564-96af-2f3d9d90ed28 req-28293c06-8552-46c2-b17f-caaef6d6926f service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received event network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8aceec4c-2ca8-4564-96af-2f3d9d90ed28 req-28293c06-8552-46c2-b17f-caaef6d6926f service nova] Acquiring lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8aceec4c-2ca8-4564-96af-2f3d9d90ed28 req-28293c06-8552-46c2-b17f-caaef6d6926f service nova] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8aceec4c-2ca8-4564-96af-2f3d9d90ed28 req-28293c06-8552-46c2-b17f-caaef6d6926f service nova] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:08 user nova-compute[82617]: DEBUG nova.compute.manager [req-8aceec4c-2ca8-4564-96af-2f3d9d90ed28 req-28293c06-8552-46c2-b17f-caaef6d6926f service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] No waiting events found dispatching network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:04:08 user nova-compute[82617]: WARNING nova.compute.manager [req-8aceec4c-2ca8-4564-96af-2f3d9d90ed28 req-28293c06-8552-46c2-b17f-caaef6d6926f service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received unexpected event network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde for instance with vm_state building and task_state spawning.
Apr 17 16:04:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681747449.8400123, 90f923a6-7f37-44c9-aacf-1d15aff0af63 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:04:09 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] VM Resumed (Lifecycle Event)
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 16:04:09 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Instance spawned successfully.
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:04:09 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681747449.8409028, 90f923a6-7f37-44c9-aacf-1d15aff0af63 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:04:09 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] VM Started (Lifecycle Event)
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 16:04:09 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 16:04:09 user nova-compute[82617]: INFO nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 17 16:04:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:04:10 user nova-compute[82617]: INFO nova.compute.manager [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Took 6.14 seconds to build instance.
Apr 17 16:04:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b8a425c6-b1fa-47f9-9ce4-cc81d5bce8fc tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.227s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-767b1864-5c19-4fb9-a38f-b9090c4f4ce5 req-4638338c-9d20-45c8-8a3e-582d515244f1 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received event network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-767b1864-5c19-4fb9-a38f-b9090c4f4ce5 req-4638338c-9d20-45c8-8a3e-582d515244f1 service nova] Acquiring lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-767b1864-5c19-4fb9-a38f-b9090c4f4ce5 req-4638338c-9d20-45c8-8a3e-582d515244f1 service nova] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-767b1864-5c19-4fb9-a38f-b9090c4f4ce5 req-4638338c-9d20-45c8-8a3e-582d515244f1 service nova] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:10 user nova-compute[82617]: DEBUG nova.compute.manager [req-767b1864-5c19-4fb9-a38f-b9090c4f4ce5 req-4638338c-9d20-45c8-8a3e-582d515244f1 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] No waiting events found dispatching network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:04:10 user nova-compute[82617]: WARNING nova.compute.manager [req-767b1864-5c19-4fb9-a38f-b9090c4f4ce5 req-4638338c-9d20-45c8-8a3e-582d515244f1 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received unexpected event network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde for instance with vm_state active and task_state None.
Apr 17 16:04:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updating instance_info_cache with network_info: [{"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d8df4619-5bda-40ff-ab7f-d76ff7e76202" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:04:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:15 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681747440.9012594, 38365a85-808f-46c5-a327-53d066e893b2 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:04:15 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 38365a85-808f-46c5-a327-53d066e893b2] VM Stopped (Lifecycle Event)
Apr 17 16:04:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9e50428e-db9c-4156-b882-4a69bb112792 None None] [instance: 38365a85-808f-46c5-a327-53d066e893b2] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:04:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:18 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:04:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:04:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:04:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:04:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:35 user nova-compute[82617]: INFO nova.compute.manager [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Terminating instance
Apr 17 16:04:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-2719ce58-965b-4fa4-b032-6a981924065b req-7b64e783-45a9-4de4-8975-d66f4ea30b34 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received event network-vif-unplugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2719ce58-965b-4fa4-b032-6a981924065b req-7b64e783-45a9-4de4-8975-d66f4ea30b34 service nova] Acquiring lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2719ce58-965b-4fa4-b032-6a981924065b req-7b64e783-45a9-4de4-8975-d66f4ea30b34 service nova] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2719ce58-965b-4fa4-b032-6a981924065b req-7b64e783-45a9-4de4-8975-d66f4ea30b34 service nova] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-2719ce58-965b-4fa4-b032-6a981924065b req-7b64e783-45a9-4de4-8975-d66f4ea30b34 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] No waiting events found dispatching network-vif-unplugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-2719ce58-965b-4fa4-b032-6a981924065b req-7b64e783-45a9-4de4-8975-d66f4ea30b34 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received event network-vif-unplugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 16:04:35 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Instance destroyed successfully.
Apr 17 16:04:35 user nova-compute[82617]: DEBUG nova.objects.instance [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lazy-loading 'resources' on Instance uuid d8df4619-5bda-40ff-ab7f-d76ff7e76202 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-360792846',display_name='tempest-AttachVolumeNegativeTest-server-360792846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-360792846',id=27,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+K/FkaYgjEBQlN2YNnrc6nwkWCGAicIMP4L/WX4WExAj+mk3c/8v326fy5lSAnyPb8sDKpO9ewLpzo8bWVFXP+ti42DVzQnWYCJ08EoiNZunVZaEV178gCO8wpN05dfg==',key_name='tempest-keypair-911544321',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8586cc10142d4743874f43cdb0f37aba',ramdisk_id='',reservation_id='r-z6u6tk6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-331389537',owner_user_name='tempest-AttachVolumeNegativeTest-331389537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:59:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fdc7c80b4654692a52c8a4c4149324f',uuid=d8df4619-5bda-40ff-ab7f-d76ff7e76202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converting VIF {"id": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "address": "fa:16:3e:56:bb:cb", "network": {"id": "5e8be34d-60fd-4295-a806-00b06e79a992", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1690191039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586cc10142d4743874f43cdb0f37aba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362d0c1-04", "ovs_interfaceid": "6362d0c1-0446-4dfe-98ad-31529ce77d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:bb:cb,bridge_name='br-int',has_traffic_filtering=True,id=6362d0c1-0446-4dfe-98ad-31529ce77d1a,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362d0c1-04') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG os_vif [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:bb:cb,bridge_name='br-int',has_traffic_filtering=True,id=6362d0c1-0446-4dfe-98ad-31529ce77d1a,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362d0c1-04') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6362d0c1-04, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:04:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:36 user nova-compute[82617]: INFO os_vif [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:bb:cb,bridge_name='br-int',has_traffic_filtering=True,id=6362d0c1-0446-4dfe-98ad-31529ce77d1a,network=Network(5e8be34d-60fd-4295-a806-00b06e79a992),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362d0c1-04')
Apr 17 16:04:36 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Deleting instance files /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202_del
Apr 17 16:04:36 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Deletion of /opt/stack/data/nova/instances/d8df4619-5bda-40ff-ab7f-d76ff7e76202_del complete
Apr 17 16:04:36 user nova-compute[82617]: INFO nova.compute.manager [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 17 16:04:36 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:04:36 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:04:36 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG nova.compute.manager [req-a20ab55b-6f90-443b-9547-02e258bdee78 req-c84fa18c-e3cd-47dd-aefc-2e4ec006ffd6 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received event network-vif-deleted-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:37 user nova-compute[82617]: INFO nova.compute.manager [req-a20ab55b-6f90-443b-9547-02e258bdee78 req-c84fa18c-e3cd-47dd-aefc-2e4ec006ffd6 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Neutron deleted interface 6362d0c1-0446-4dfe-98ad-31529ce77d1a; detaching it from the instance and deleting it from the info cache
Apr 17 16:04:37 user nova-compute[82617]: DEBUG nova.network.neutron [req-a20ab55b-6f90-443b-9547-02e258bdee78 req-c84fa18c-e3cd-47dd-aefc-2e4ec006ffd6 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:04:37 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Took 0.94 seconds to deallocate network for instance.
Apr 17 16:04:37 user nova-compute[82617]: DEBUG nova.compute.manager [req-a20ab55b-6f90-443b-9547-02e258bdee78 req-c84fa18c-e3cd-47dd-aefc-2e4ec006ffd6 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Detach interface failed, port_id=6362d0c1-0446-4dfe-98ad-31529ce77d1a, reason: Instance d8df4619-5bda-40ff-ab7f-d76ff7e76202 could not be found. {{(pid=82617) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:37 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Deleted allocations for instance d8df4619-5bda-40ff-ab7f-d76ff7e76202
Apr 17 16:04:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-9ce02919-951b-4956-b58d-952ca34359d0 tempest-AttachVolumeNegativeTest-331389537 tempest-AttachVolumeNegativeTest-331389537-project-member] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG nova.compute.manager [req-461dbabe-aed3-4101-b5e0-747c0f37a7de req-dfdbe087-3317-4ed6-aa88-a3a1eed65390 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received event network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-461dbabe-aed3-4101-b5e0-747c0f37a7de req-dfdbe087-3317-4ed6-aa88-a3a1eed65390 service nova] Acquiring lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-461dbabe-aed3-4101-b5e0-747c0f37a7de req-dfdbe087-3317-4ed6-aa88-a3a1eed65390 service nova] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-461dbabe-aed3-4101-b5e0-747c0f37a7de req-dfdbe087-3317-4ed6-aa88-a3a1eed65390 service nova] Lock "d8df4619-5bda-40ff-ab7f-d76ff7e76202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:37 user nova-compute[82617]: DEBUG nova.compute.manager [req-461dbabe-aed3-4101-b5e0-747c0f37a7de req-dfdbe087-3317-4ed6-aa88-a3a1eed65390 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] No waiting events found dispatching network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:04:37 user nova-compute[82617]: WARNING nova.compute.manager [req-461dbabe-aed3-4101-b5e0-747c0f37a7de req-dfdbe087-3317-4ed6-aa88-a3a1eed65390 service nova] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Received unexpected event network-vif-plugged-6362d0c1-0446-4dfe-98ad-31529ce77d1a for instance with vm_state deleted and task_state None.
Apr 17 16:04:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:04:50 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681747475.9634423, d8df4619-5bda-40ff-ab7f-d76ff7e76202 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:04:50 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] VM Stopped (Lifecycle Event)
Apr 17 16:04:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-9851cd1f-accc-42f6-909b-391c110d078a None None] [instance: d8df4619-5bda-40ff-ab7f-d76ff7e76202] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:04:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:04:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:04:57 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:04:58 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:04:58 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=26.141677856445312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 90f923a6-7f37-44c9-aacf-1d15aff0af63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:04:58 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:05:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:05:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:07 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:05:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:05:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:05:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:05:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:05:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:05:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:15 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:05:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:05:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:05:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:05:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:05:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:05:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-12ee0649-2efd-4479-a440-2d5d538e00a4 req-c440b5d2-5243-4e31-b678-bcdb1eeba55f service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received event network-changed-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:05:54 user nova-compute[82617]: DEBUG nova.compute.manager [req-12ee0649-2efd-4479-a440-2d5d538e00a4 req-c440b5d2-5243-4e31-b678-bcdb1eeba55f service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Refreshing instance network info cache due to event network-changed-13859f03-8c8c-4f84-8de0-3126989f4cde. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 16:05:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-12ee0649-2efd-4479-a440-2d5d538e00a4 req-c440b5d2-5243-4e31-b678-bcdb1eeba55f service nova] Acquiring lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:05:54 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-12ee0649-2efd-4479-a440-2d5d538e00a4 req-c440b5d2-5243-4e31-b678-bcdb1eeba55f service nova] Acquired lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:05:54 user nova-compute[82617]: DEBUG nova.network.neutron [req-12ee0649-2efd-4479-a440-2d5d538e00a4 req-c440b5d2-5243-4e31-b678-bcdb1eeba55f service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Refreshing network info cache for port 13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 16:05:55 user nova-compute[82617]: DEBUG nova.network.neutron [req-12ee0649-2efd-4479-a440-2d5d538e00a4 req-c440b5d2-5243-4e31-b678-bcdb1eeba55f service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updated VIF entry in instance network info cache for port 13859f03-8c8c-4f84-8de0-3126989f4cde. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 16:05:55 user nova-compute[82617]: DEBUG nova.network.neutron [req-12ee0649-2efd-4479-a440-2d5d538e00a4 req-c440b5d2-5243-4e31-b678-bcdb1eeba55f service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updating instance_info_cache with network_info: [{"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:05:55 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-12ee0649-2efd-4479-a440-2d5d538e00a4 req-c440b5d2-5243-4e31-b678-bcdb1eeba55f service nova] Releasing lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:05:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:05:56 user nova-compute[82617]: ERROR nova.volume.cinder [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Delete attachment failed for attachment a68f5fc4-dea3-48a4-bdb0-1d89db356c29. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-843599cc-4c80-4fe3-81ef-b83c113ecd84) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-843599cc-4c80-4fe3-81ef-b83c113ecd84)
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:05:59 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:06:00 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:06:00 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8444MB free_disk=26.12783432006836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 90f923a6-7f37-44c9-aacf-1d15aff0af63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:06:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:07 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:06:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updating instance_info_cache with network_info: [{"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:06:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:15 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:18 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:06:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:06:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:06:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:06:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:06:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:07:01 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:07:02 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:07:02 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=26.125652313232422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 90f923a6-7f37-44c9-aacf-1d15aff0af63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:07:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:07:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:06 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:07:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:07:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:07:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:07:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:07:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:07:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:07:16 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:16 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:07:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:07:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:07:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:07:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:07:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:07:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:07:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:07:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:07:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:07:56 user nova-compute[82617]: ERROR nova.volume.cinder [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Delete attachment failed for attachment a68f5fc4-dea3-48a4-bdb0-1d89db356c29. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-6f2f6ab3-3788-404c-8060-061f30d95d4f) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-6f2f6ab3-3788-404c-8060-061f30d95d4f)
Apr 17 16:08:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:08:02 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:08:03 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:08:03 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=26.122005462646484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 90f923a6-7f37-44c9-aacf-1d15aff0af63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:08:03 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:08:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:08:07 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:08:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:08:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:16 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:08:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:08:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:08:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:08:17 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:08:17 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updating instance_info_cache with network_info: [{"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:08:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-90f923a6-7f37-44c9-aacf-1d15aff0af63" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:08:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:08:18 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:08:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:08:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:08:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:08:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:08:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:08:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:08:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:08:31 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:08:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:08:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:08:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:08:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:08:46 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:08:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:08:56 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:09:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:09:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:09:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:09:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:09:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:09:04 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:09:05 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:09:05 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8517MB free_disk=26.118988037109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 90f923a6-7f37-44c9-aacf-1d15aff0af63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:09:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:09:06 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:09:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "90f923a6-7f37-44c9-aacf-1d15aff0af63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:09:11 user nova-compute[82617]: INFO nova.compute.manager [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Terminating instance
Apr 17 16:09:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG nova.compute.manager [req-007747ea-e40f-424d-a4ee-d33e9e65eac0 req-a746b077-f5da-4e50-90d0-6f3a00e960a9 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received event network-vif-unplugged-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-007747ea-e40f-424d-a4ee-d33e9e65eac0 req-a746b077-f5da-4e50-90d0-6f3a00e960a9 service nova] Acquiring lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-007747ea-e40f-424d-a4ee-d33e9e65eac0 req-a746b077-f5da-4e50-90d0-6f3a00e960a9 service nova] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-007747ea-e40f-424d-a4ee-d33e9e65eac0 req-a746b077-f5da-4e50-90d0-6f3a00e960a9 service nova] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG nova.compute.manager [req-007747ea-e40f-424d-a4ee-d33e9e65eac0 req-a746b077-f5da-4e50-90d0-6f3a00e960a9 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] No waiting events found dispatching network-vif-unplugged-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:09:11 user nova-compute[82617]: DEBUG nova.compute.manager [req-007747ea-e40f-424d-a4ee-d33e9e65eac0 req-a746b077-f5da-4e50-90d0-6f3a00e960a9 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received event network-vif-unplugged-13859f03-8c8c-4f84-8de0-3126989f4cde for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 16:09:12 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Instance destroyed successfully.
Apr 17 16:09:12 user nova-compute[82617]: DEBUG nova.objects.instance [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lazy-loading 'resources' on Instance uuid 90f923a6-7f37-44c9-aacf-1d15aff0af63 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1343390848',display_name='tempest-AttachVolumeTestJSON-server-1343390848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1343390848',id=28,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZDRHFLc5GDg1Ipp9BWhdjmE4gVjyAH89nS8xe4jSsCGN/gzX8ygBw+cM2bfVcDbURrjFfMGidK7X8fc/EymaND4LhBjs3W8Gs0RC43DltkXT1bPMCHVm+SGH7nWpsC6g==',key_name='tempest-keypair-888711113',keypairs=<?>,launch_index=0,launched_at=2023-04-17T16:04:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2eb998c84b5b41e599af9636b929295d',ramdisk_id='',reservation_id='r-pl4az9rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1193954556',owner_user_name='tempest-AttachVolumeTestJSON-1193954556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T16:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d4a317838b47d6a2a2e7eab7a453dd',uuid=90f923a6-7f37-44c9-aacf-1d15aff0af63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converting VIF {"id": "13859f03-8c8c-4f84-8de0-3126989f4cde", "address": "fa:16:3e:a5:c4:5a", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13859f03-8c", "ovs_interfaceid": "13859f03-8c8c-4f84-8de0-3126989f4cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=13859f03-8c8c-4f84-8de0-3126989f4cde,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13859f03-8c') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG os_vif [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=13859f03-8c8c-4f84-8de0-3126989f4cde,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13859f03-8c') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13859f03-8c, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:12 user nova-compute[82617]: INFO os_vif [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=13859f03-8c8c-4f84-8de0-3126989f4cde,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13859f03-8c')
Apr 17 16:09:12 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Deleting instance files /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63_del
Apr 17 16:09:12 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Deletion of /opt/stack/data/nova/instances/90f923a6-7f37-44c9-aacf-1d15aff0af63_del complete
Apr 17 16:09:12 user nova-compute[82617]: INFO nova.compute.manager [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 17 16:09:12 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:09:12 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:09:13 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Took 1.22 seconds to deallocate network for instance.
Apr 17 16:09:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-409dd6e8-08d0-4542-ba04-78517ef202d0 req-de513ca2-648c-4d27-b316-81082440683c service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received event network-vif-deleted-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:09:13 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Deleted allocations for instance 90f923a6-7f37-44c9-aacf-1d15aff0af63
Apr 17 16:09:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-99f681fd-2726-4f11-8d7f-b84e1382ca6f req-7de0cb0e-290c-46c5-ad81-af010d51d7b4 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received event network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-99f681fd-2726-4f11-8d7f-b84e1382ca6f req-7de0cb0e-290c-46c5-ad81-af010d51d7b4 service nova] Acquiring lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-99f681fd-2726-4f11-8d7f-b84e1382ca6f req-7de0cb0e-290c-46c5-ad81-af010d51d7b4 service nova] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-99f681fd-2726-4f11-8d7f-b84e1382ca6f req-7de0cb0e-290c-46c5-ad81-af010d51d7b4 service nova] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:09:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-99f681fd-2726-4f11-8d7f-b84e1382ca6f req-7de0cb0e-290c-46c5-ad81-af010d51d7b4 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] No waiting events found dispatching network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:09:13 user nova-compute[82617]: WARNING nova.compute.manager [req-99f681fd-2726-4f11-8d7f-b84e1382ca6f req-7de0cb0e-290c-46c5-ad81-af010d51d7b4 service nova] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Received unexpected event network-vif-plugged-13859f03-8c8c-4f84-8de0-3126989f4cde for instance with vm_state deleted and task_state None.
Apr 17 16:09:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-8153267c-e9bd-41a9-8668-f81cadf98f7b tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "90f923a6-7f37-44c9-aacf-1d15aff0af63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.436s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:09:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:09:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:09:22 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:09:27 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681747752.0886495, 90f923a6-7f37-44c9-aacf-1d15aff0af63 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:09:27 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] VM Stopped (Lifecycle Event)
Apr 17 16:09:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-744bd3d4-29d5-445d-8cb2-86ed03269562 None None] [instance: 90f923a6-7f37-44c9-aacf-1d15aff0af63] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:09:27 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:09:32 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:09:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:42 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:47 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:52 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:09:56 user nova-compute[82617]: ERROR nova.volume.cinder [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Delete attachment failed for attachment a68f5fc4-dea3-48a4-bdb0-1d89db356c29. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-de825ae0-7573-4fdc-8780-dc5a66cd78ec) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-de825ae0-7573-4fdc-8780-dc5a66cd78ec)
Apr 17 16:09:57 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:02 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:10:05 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:10:05 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:10:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8614MB free_disk=26.127788543701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:10:05 user nova-compute[82617]: INFO nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d1695560-531a-4bc2-ba83-0ded0eab8d54 has allocations against this compute host but is not found in the database.
Apr 17 16:10:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:10:05 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 16:10:06 user nova-compute[82617]: INFO nova.compute.claims [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Claim successful on node user
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.network.neutron [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 16:10:06 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.policy [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9d4a317838b47d6a2a2e7eab7a453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb998c84b5b41e599af9636b929295d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 16:10:06 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Creating image(s)
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "/opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "/opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.138s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk 1073741824" returned: 0 in 0.048s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.network.neutron [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Successfully created port: cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Cannot resize image /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.objects.instance [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lazy-loading 'migration_context' on Instance uuid d1695560-531a-4bc2-ba83-0ded0eab8d54 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Ensure instance console log exists: /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.network.neutron [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Successfully updated port: cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquired lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.network.neutron [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.compute.manager [req-e3c70a6d-0b04-4160-8d70-2aefed8192fd req-925e2094-5872-412c-8d5b-95b109fb7f8a service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received event network-changed-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.compute.manager [req-e3c70a6d-0b04-4160-8d70-2aefed8192fd req-925e2094-5872-412c-8d5b-95b109fb7f8a service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Refreshing instance network info cache due to event network-changed-cc92c125-9bd3-4395-a1e6-595bc936b1a3. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e3c70a6d-0b04-4160-8d70-2aefed8192fd req-925e2094-5872-412c-8d5b-95b109fb7f8a service nova] Acquiring lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:10:07 user nova-compute[82617]: DEBUG nova.network.neutron [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.network.neutron [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updating instance_info_cache with network_info: [{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Releasing lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Instance network_info: |[{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e3c70a6d-0b04-4160-8d70-2aefed8192fd req-925e2094-5872-412c-8d5b-95b109fb7f8a service nova] Acquired lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-e3c70a6d-0b04-4160-8d70-2aefed8192fd req-925e2094-5872-412c-8d5b-95b109fb7f8a service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Refreshing network info cache for port cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Start _get_guest_xml network_info=[{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 16:10:08 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:10:08 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-60777785',display_name='tempest-AttachVolumeTestJSON-server-60777785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-60777785',id=29,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPC1+6jDt6Hwh/sTiAiEFNhvD6ggy52koIuU368UWYx1Md1npga+0+MndM6LNtALd11qK/GnXjwsvH4m79Bpr4FbBXbkTVcBvXC/DLIA5wJOFy7nWmCwLeQ+KIAl++4jA==',key_name='tempest-keypair-161401027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eb998c84b5b41e599af9636b929295d',ramdisk_id='',reservation_id='r-xqxh1o9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1193954556',owner_user_name='tempest-AttachVolumeTestJSON-1193954556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T16:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d4a317838b47d6a2a2e7eab7a453dd',uuid=d1695560-531a-4bc2-ba83-0ded0eab8d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converting VIF {"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8c:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc92c125-9bd3-4395-a1e6-595bc936b1a3,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc92c125-9b') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.objects.instance [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lazy-loading 'pci_devices' on Instance uuid d1695560-531a-4bc2-ba83-0ded0eab8d54 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] End _get_guest_xml xml=<domain type="kvm">
Apr 17 16:10:08 user nova-compute[82617]:   <uuid>d1695560-531a-4bc2-ba83-0ded0eab8d54</uuid>
Apr 17 16:10:08 user nova-compute[82617]:   <name>instance-0000001d</name>
Apr 17 16:10:08 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 16:10:08 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 16:10:08 user nova-compute[82617]:   <metadata>
Apr 17 16:10:08 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 16:10:08 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 16:10:08 user nova-compute[82617]:       <nova:name>tempest-AttachVolumeTestJSON-server-60777785</nova:name>
Apr 17 16:10:08 user nova-compute[82617]:       <nova:creationTime>2023-04-17 16:10:08</nova:creationTime>
Apr 17 16:10:08 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 16:10:08 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 16:10:08 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 16:10:08 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 16:10:08 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 16:10:08 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 16:10:08 user nova-compute[82617]:       </nova:flavor>
Apr 17 16:10:08 user nova-compute[82617]:       <nova:owner>
Apr 17 16:10:08 user nova-compute[82617]:         <nova:user uuid="b9d4a317838b47d6a2a2e7eab7a453dd">tempest-AttachVolumeTestJSON-1193954556-project-member</nova:user>
Apr 17 16:10:08 user nova-compute[82617]:         <nova:project uuid="2eb998c84b5b41e599af9636b929295d">tempest-AttachVolumeTestJSON-1193954556</nova:project>
Apr 17 16:10:08 user nova-compute[82617]:       </nova:owner>
Apr 17 16:10:08 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 16:10:08 user nova-compute[82617]:       <nova:ports>
Apr 17 16:10:08 user nova-compute[82617]:         <nova:port uuid="cc92c125-9bd3-4395-a1e6-595bc936b1a3">
Apr 17 16:10:08 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 17 16:10:08 user nova-compute[82617]:         </nova:port>
Apr 17 16:10:08 user nova-compute[82617]:       </nova:ports>
Apr 17 16:10:08 user nova-compute[82617]:     </nova:instance>
Apr 17 16:10:08 user nova-compute[82617]:   </metadata>
Apr 17 16:10:08 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 16:10:08 user nova-compute[82617]:     <system>
Apr 17 16:10:08 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 16:10:08 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 16:10:08 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 16:10:08 user nova-compute[82617]:       <entry name="serial">d1695560-531a-4bc2-ba83-0ded0eab8d54</entry>
Apr 17 16:10:08 user nova-compute[82617]:       <entry name="uuid">d1695560-531a-4bc2-ba83-0ded0eab8d54</entry>
Apr 17 16:10:08 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 16:10:08 user nova-compute[82617]:     </system>
Apr 17 16:10:08 user nova-compute[82617]:   </sysinfo>
Apr 17 16:10:08 user nova-compute[82617]:   <os>
Apr 17 16:10:08 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 16:10:08 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 16:10:08 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 16:10:08 user nova-compute[82617]:   </os>
Apr 17 16:10:08 user nova-compute[82617]:   <features>
Apr 17 16:10:08 user nova-compute[82617]:     <acpi/>
Apr 17 16:10:08 user nova-compute[82617]:     <apic/>
Apr 17 16:10:08 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 16:10:08 user nova-compute[82617]:   </features>
Apr 17 16:10:08 user nova-compute[82617]:   <clock offset="utc">
Apr 17 16:10:08 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 16:10:08 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 16:10:08 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 16:10:08 user nova-compute[82617]:   </clock>
Apr 17 16:10:08 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 16:10:08 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 16:10:08 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 16:10:08 user nova-compute[82617]:   </cpu>
Apr 17 16:10:08 user nova-compute[82617]:   <devices>
Apr 17 16:10:08 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 16:10:08 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 16:10:08 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk"/>
Apr 17 16:10:08 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 16:10:08 user nova-compute[82617]:     </disk>
Apr 17 16:10:08 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 16:10:08 user nova-compute[82617]:       <mac address="fa:16:3e:64:8c:a3"/>
Apr 17 16:10:08 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 16:10:08 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 16:10:08 user nova-compute[82617]:       <target dev="tapcc92c125-9b"/>
Apr 17 16:10:08 user nova-compute[82617]:     </interface>
Apr 17 16:10:08 user nova-compute[82617]:     <serial type="pty">
Apr 17 16:10:08 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/console.log" append="off"/>
Apr 17 16:10:08 user nova-compute[82617]:     </serial>
Apr 17 16:10:08 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 16:10:08 user nova-compute[82617]:     <video>
Apr 17 16:10:08 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 16:10:08 user nova-compute[82617]:     </video>
Apr 17 16:10:08 user nova-compute[82617]:     <rng model="virtio">
Apr 17 16:10:08 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 16:10:08 user nova-compute[82617]:     </rng>
Apr 17 16:10:08 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 16:10:08 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 16:10:08 user nova-compute[82617]:       <stats period="10"/>
Apr 17 16:10:08 user nova-compute[82617]:     </memballoon>
Apr 17 16:10:08 user nova-compute[82617]:   </devices>
Apr 17 16:10:08 user nova-compute[82617]: </domain>
Apr 17 16:10:08 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-60777785',display_name='tempest-AttachVolumeTestJSON-server-60777785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-60777785',id=29,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPC1+6jDt6Hwh/sTiAiEFNhvD6ggy52koIuU368UWYx1Md1npga+0+MndM6LNtALd11qK/GnXjwsvH4m79Bpr4FbBXbkTVcBvXC/DLIA5wJOFy7nWmCwLeQ+KIAl++4jA==',key_name='tempest-keypair-161401027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eb998c84b5b41e599af9636b929295d',ramdisk_id='',reservation_id='r-xqxh1o9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1193954556',owner_user_name='tempest-AttachVolumeTestJSON-1193954556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T16:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d4a317838b47d6a2a2e7eab7a453dd',uuid=d1695560-531a-4bc2-ba83-0ded0eab8d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converting VIF {"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8c:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc92c125-9bd3-4395-a1e6-595bc936b1a3,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc92c125-9b') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG os_vif [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8c:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc92c125-9bd3-4395-a1e6-595bc936b1a3,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc92c125-9b') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc92c125-9b, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc92c125-9b, col_values=(('external_ids', {'iface-id': 'cc92c125-9bd3-4395-a1e6-595bc936b1a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:8c:a3', 'vm-uuid': 'd1695560-531a-4bc2-ba83-0ded0eab8d54'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:08 user nova-compute[82617]: INFO os_vif [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8c:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc92c125-9bd3-4395-a1e6-595bc936b1a3,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc92c125-9b')
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] No VIF found with MAC fa:16:3e:64:8c:a3, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-e3c70a6d-0b04-4160-8d70-2aefed8192fd req-925e2094-5872-412c-8d5b-95b109fb7f8a service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updated VIF entry in instance network info cache for port cc92c125-9bd3-4395-a1e6-595bc936b1a3. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG nova.network.neutron [req-e3c70a6d-0b04-4160-8d70-2aefed8192fd req-925e2094-5872-412c-8d5b-95b109fb7f8a service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updating instance_info_cache with network_info: [{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:10:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e3c70a6d-0b04-4160-8d70-2aefed8192fd req-925e2094-5872-412c-8d5b-95b109fb7f8a service nova] Releasing lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG nova.compute.manager [req-e2182f3d-8d5a-4371-b11d-047ff4de48c2 req-b5050783-6449-4408-ad72-fbd57cefa25e service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received event network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e2182f3d-8d5a-4371-b11d-047ff4de48c2 req-b5050783-6449-4408-ad72-fbd57cefa25e service nova] Acquiring lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e2182f3d-8d5a-4371-b11d-047ff4de48c2 req-b5050783-6449-4408-ad72-fbd57cefa25e service nova] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-e2182f3d-8d5a-4371-b11d-047ff4de48c2 req-b5050783-6449-4408-ad72-fbd57cefa25e service nova] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:09 user nova-compute[82617]: DEBUG nova.compute.manager [req-e2182f3d-8d5a-4371-b11d-047ff4de48c2 req-b5050783-6449-4408-ad72-fbd57cefa25e service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] No waiting events found dispatching network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:10:09 user nova-compute[82617]: WARNING nova.compute.manager [req-e2182f3d-8d5a-4371-b11d-047ff4de48c2 req-b5050783-6449-4408-ad72-fbd57cefa25e service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received unexpected event network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 for instance with vm_state building and task_state spawning.
Apr 17 16:10:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681747811.9218316, d1695560-531a-4bc2-ba83-0ded0eab8d54 => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:10:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] VM Resumed (Lifecycle Event)
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.compute.manager [req-9a20103a-790a-4d7e-b851-94704cc5ac12 req-5ca8abc7-5d69-4a79-b9c6-775bbd3a7edc service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received event network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9a20103a-790a-4d7e-b851-94704cc5ac12 req-5ca8abc7-5d69-4a79-b9c6-775bbd3a7edc service nova] Acquiring lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9a20103a-790a-4d7e-b851-94704cc5ac12 req-5ca8abc7-5d69-4a79-b9c6-775bbd3a7edc service nova] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-9a20103a-790a-4d7e-b851-94704cc5ac12 req-5ca8abc7-5d69-4a79-b9c6-775bbd3a7edc service nova] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.compute.manager [req-9a20103a-790a-4d7e-b851-94704cc5ac12 req-5ca8abc7-5d69-4a79-b9c6-775bbd3a7edc service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] No waiting events found dispatching network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:10:11 user nova-compute[82617]: WARNING nova.compute.manager [req-9a20103a-790a-4d7e-b851-94704cc5ac12 req-5ca8abc7-5d69-4a79-b9c6-775bbd3a7edc service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received unexpected event network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 for instance with vm_state building and task_state spawning.
Apr 17 16:10:11 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Instance spawned successfully.
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 16:10:11 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 16:10:11 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681747811.9248924, d1695560-531a-4bc2-ba83-0ded0eab8d54 => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:10:12 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] VM Started (Lifecycle Event)
Apr 17 16:10:12 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:10:12 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 16:10:12 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 16:10:12 user nova-compute[82617]: INFO nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 17 16:10:12 user nova-compute[82617]: DEBUG nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:10:12 user nova-compute[82617]: INFO nova.compute.manager [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Took 6.09 seconds to build instance.
Apr 17 16:10:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-3857b6b4-9a33-41c3-a5bc-37fc52f5fb15 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.182s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:10:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:23 user nova-compute[82617]: INFO nova.compute.manager [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Terminating instance
Apr 17 16:10:23 user nova-compute[82617]: DEBUG nova.compute.manager [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:10:23 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Instance destroyed successfully.
Apr 17 16:10:23 user nova-compute[82617]: DEBUG nova.objects.instance [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lazy-loading 'resources' on Instance uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T15:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-765067727',display_name='tempest-ServerStableDeviceRescueTest-server-765067727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-765067727',id=3,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR2JdSi+da6BnbUL1hFO3Ku02OwrmKfJuXj9P3Ezj/X2hlOgPsocvEmY0qLTq4AOoVu5vKe2On73/43+BWss3ne+tcJcBX/XQHcOOL4ILUdxQAMJED5bkmazbJQaFRpzQ==',key_name='tempest-keypair-1194004845',keypairs=<?>,launch_index=0,launched_at=2023-04-17T15:28:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6bdfb8642b9341f6ba289e920c33cf47',ramdisk_id='',reservation_id='r-dawq23oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-869290889',owner_user_name='tempest-ServerStableDeviceRescueTest-869290889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T15:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a972c04314724233bc8e33b64747fecf',uuid=fc3385ee-a569-4a45-812b-b9073d774535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Converting VIF {"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:22:83,bridge_name='br-int',has_traffic_filtering=True,id=06c113c7-a663-47b8-a618-0a22d3e345a4,network=Network(7925f982-32fb-4fc9-b421-8dffeb064b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c113c7-a6') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_vif [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:22:83,bridge_name='br-int',has_traffic_filtering=True,id=06c113c7-a663-47b8-a618-0a22d3e345a4,network=Network(7925f982-32fb-4fc9-b421-8dffeb064b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c113c7-a6') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06c113c7-a6, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:10:23 user nova-compute[82617]: INFO os_vif [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:22:83,bridge_name='br-int',has_traffic_filtering=True,id=06c113c7-a663-47b8-a618-0a22d3e345a4,network=Network(7925f982-32fb-4fc9-b421-8dffeb064b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c113c7-a6')
Apr 17 16:10:23 user nova-compute[82617]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] calling os-brick to detach iSCSI Volume {{(pid=82617) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd648318cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmhLYVJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 17 16:10:23 user nova-compute[82617]: WARNING os_brick.initiator.connectors.base [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ecb22c-189c-46ff-8997-1211d93c1053]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 17 16:10:23 user nova-compute[82617]: No targets found.
Apr 17 16:10:23 user nova-compute[82617]: iSNS:
Apr 17 16:10:23 user nova-compute[82617]: No targets found.
Apr 17 16:10:23 user nova-compute[82617]: STATIC:
Apr 17 16:10:23 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9
Apr 17 16:10:23 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 16:10:23 user nova-compute[82617]:                 Iface Name: default
Apr 17 16:10:23 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214
Apr 17 16:10:23 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 16:10:23 user nova-compute[82617]:                 Iface Name: default
Apr 17 16:10:23 user nova-compute[82617]: Target: iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911
Apr 17 16:10:23 user nova-compute[82617]:         Portal: 172.16.0.220:3260,-1
Apr 17 16:10:23 user nova-compute[82617]:                 Iface Name: default
Apr 17 16:10:23 user nova-compute[82617]: FIRMWARE:
Apr 17 16:10:23 user nova-compute[82617]: No targets found.
Apr 17 16:10:23 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 17 16:10:23 user nova-compute[82617]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 17 16:10:23 user nova-compute[82617]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82617) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911', 0)] {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab08abe-c367-4125-af92-bc6e4ef4bc18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b30d0-56e8-4e0e-acb7-da5f360ddfdb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 16:10:23 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 16:10:23 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 16:10:23 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911 (non-flash)
Apr 17 16:10:23 user nova-compute[82617]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1072d05f-2ebb-4398-902c-902df25464e9 (non-flash)
Apr 17 16:10:23 user nova-compute[82617]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13bf568b-585c-4556-ab78-e9930ad50214 (non-flash)
Apr 17 16:10:23 user nova-compute[82617]:  stderr= {{(pid=82617) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd628133e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32819ec1-2236-465f-a1c7-ee31aa4a0911'): ({'sdb'}, set())}) {{(pid=82617) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Removing single pathed devices sdb {{(pid=82617) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[f887cc39-1e23-4cc8-8c95-4a911a272096]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e566b6-bf77-4f43-83fb-969388d9498d]: (4, ('ok\n', '')) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.initiator.linuxscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Flushing IO for device /dev/sdb {{(pid=82617) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 1 in 0.014s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdb' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 20 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 16:10:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:10:31 user nova-compute[82617]: WARNING nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Apr 17 16:10:31 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid d109f8c3-aed3-45af-ba8d-30b9006ef4e4 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:10:31 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:10:31 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid d1695560-531a-4bc2-ba83-0ded0eab8d54 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:10:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "fc3385ee-a569-4a45-812b-b9073d774535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:10:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:10:31 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:10:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:10:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:10:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:10:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:10:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:10:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 1 in 20.034s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:10:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdb' failed. Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:477}}
Apr 17 16:10:43 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:10:43 user nova-compute[82617]: DEBUG os_brick.privileged.rootwrap [-] Sleeping for 40 seconds {{(pid=92892) on_execute /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:106}}
Apr 17 16:10:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:10:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:10:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:10:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:10:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:10:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:10:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:10:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:11:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82617) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:11:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:11:07 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:11:07 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8501MB free_disk=26.177398681640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d1695560-531a-4bc2-ba83-0ded0eab8d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:11:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:11:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:11:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:12 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:12 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:11:12 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-316bb9a2-9b1b-4956-aa54-83b2dedf0747 req-53e92c8e-00bb-4967-9d1f-e46a64d61fc8 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:11:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-316bb9a2-9b1b-4956-aa54-83b2dedf0747 req-53e92c8e-00bb-4967-9d1f-e46a64d61fc8 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing instance network info cache due to event network-changed-06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 16:11:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-316bb9a2-9b1b-4956-aa54-83b2dedf0747 req-53e92c8e-00bb-4967-9d1f-e46a64d61fc8 service nova] Acquiring lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:11:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-316bb9a2-9b1b-4956-aa54-83b2dedf0747 req-53e92c8e-00bb-4967-9d1f-e46a64d61fc8 service nova] Acquired lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:11:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-316bb9a2-9b1b-4956-aa54-83b2dedf0747 req-53e92c8e-00bb-4967-9d1f-e46a64d61fc8 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Refreshing network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 16:11:15 user nova-compute[82617]: DEBUG nova.network.neutron [req-316bb9a2-9b1b-4956-aa54-83b2dedf0747 req-53e92c8e-00bb-4967-9d1f-e46a64d61fc8 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updated VIF entry in instance network info cache for port 06c113c7-a663-47b8-a618-0a22d3e345a4. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 16:11:15 user nova-compute[82617]: DEBUG nova.network.neutron [req-316bb9a2-9b1b-4956-aa54-83b2dedf0747 req-53e92c8e-00bb-4967-9d1f-e46a64d61fc8 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [{"id": "06c113c7-a663-47b8-a618-0a22d3e345a4", "address": "fa:16:3e:b8:22:83", "network": {"id": "7925f982-32fb-4fc9-b421-8dffeb064b27", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-803986041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdfb8642b9341f6ba289e920c33cf47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c113c7-a6", "ovs_interfaceid": "06c113c7-a663-47b8-a618-0a22d3e345a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:11:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-316bb9a2-9b1b-4956-aa54-83b2dedf0747 req-53e92c8e-00bb-4967-9d1f-e46a64d61fc8 service nova] Releasing lock "refresh_cache-fc3385ee-a569-4a45-812b-b9073d774535" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:11:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:18 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:20 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:11:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:11:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:11:20 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:11:21 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updating instance_info_cache with network_info: [{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:11:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:11:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:11:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 1 in 40.043s {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:11:23 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [-] 'blockdev --flushbufs /dev/sdb' failed. Not Retrying. {{(pid=92892) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 17 16:11:23 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[46a3f62a-f0f6-4820-a89f-f28c52fa66b4]: Unexpected error while running command.
Apr 17 16:11:23 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdb
Apr 17 16:11:23 user nova-compute[82617]: Exit code: 1
Apr 17 16:11:23 user nova-compute[82617]: Stdout: ''
Apr 17 16:11:23 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdb: No such device or address\n' {{(pid=92892) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 17 16:11:23 user nova-compute[82617]: Traceback (most recent call last):
Apr 17 16:11:23 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 17 16:11:23 user nova-compute[82617]:     ret = func(*f_args, **f_kwargs)
Apr 17 16:11:23 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 17 16:11:23 user nova-compute[82617]:     return func(*args, **kwargs)
Apr 17 16:11:23 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 17 16:11:23 user nova-compute[82617]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 17 16:11:23 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 17 16:11:23 user nova-compute[82617]:     return putils.execute(on_execute=on_execute,
Apr 17 16:11:23 user nova-compute[82617]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 17 16:11:23 user nova-compute[82617]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 17 16:11:23 user nova-compute[82617]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 16:11:23 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdb
Apr 17 16:11:23 user nova-compute[82617]: Exit code: 1
Apr 17 16:11:23 user nova-compute[82617]: Stdout: ''
Apr 17 16:11:23 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdb: No such device or address\n'
Apr 17 16:11:23 user nova-compute[82617]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3f62a-f0f6-4820-a89f-f28c52fa66b4]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('', 'blockdev: cannot open /dev/sdb: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdb', None)) {{(pid=92892) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 17 16:11:23 user nova-compute[82617]: WARNING os_brick.initiator.linuxscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Failed to flush IO buffers prior to removing device: 1: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 16:11:23 user nova-compute[82617]: WARNING os_brick.exception [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Flushing /dev/sdb failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 16:11:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.base [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.249s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 17 16:11:23 user nova-compute[82617]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] <== disconnect_volume: exception (60251ms) ProcessExecutionError('', 'blockdev: cannot open /dev/sdb: No such device or address\n', 1, 'blockdev --flushbufs /dev/sdb', None) {{(pid=82617) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:188}}
Apr 17 16:11:23 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Ignoring Volume Error on vol 32819ec1-2236-465f-a1c7-ee31aa4a0911 during delete Unexpected error while running command.
Apr 17 16:11:23 user nova-compute[82617]: Command: blockdev --flushbufs /dev/sdb
Apr 17 16:11:23 user nova-compute[82617]: Exit code: 1
Apr 17 16:11:23 user nova-compute[82617]: Stdout: ''
Apr 17 16:11:23 user nova-compute[82617]: Stderr: 'blockdev: cannot open /dev/sdb: No such device or address\n': oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 17 16:11:23 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Deleting instance files /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535_del
Apr 17 16:11:23 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Deletion of /opt/stack/data/nova/instances/fc3385ee-a569-4a45-812b-b9073d774535_del complete
Apr 17 16:11:23 user nova-compute[82617]: INFO nova.compute.manager [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Took 60.36 seconds to destroy the instance on the hypervisor.
Apr 17 16:11:23 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:11:23 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:11:23 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:11:24 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:11:24 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Took 0.54 seconds to deallocate network for instance.
Apr 17 16:11:24 user nova-compute[82617]: DEBUG nova.compute.manager [req-ab48edf0-1200-4443-adc3-13ac750a6170 req-eb866c60-ec33-48b0-8745-3a3a2f3db0f9 service nova] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Received event network-vif-deleted-06c113c7-a663-47b8-a618-0a22d3e345a4 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:11:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:11:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:11:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:11:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:11:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:11:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:56 user nova-compute[82617]: ERROR nova.volume.cinder [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Delete attachment failed for attachment a68f5fc4-dea3-48a4-bdb0-1d89db356c29. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-15d5486a-4efe-4884-8b8c-05a078b8fa5f) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-15d5486a-4efe-4884-8b8c-05a078b8fa5f)
Apr 17 16:11:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-c08178ef-67c5-4e81-b34a-f6838d781faf req-e17f1b35-af34-4cc7-99b4-33761a7555a8 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received event network-changed-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:11:57 user nova-compute[82617]: DEBUG nova.compute.manager [req-c08178ef-67c5-4e81-b34a-f6838d781faf req-e17f1b35-af34-4cc7-99b4-33761a7555a8 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Refreshing instance network info cache due to event network-changed-cc92c125-9bd3-4395-a1e6-595bc936b1a3. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 16:11:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c08178ef-67c5-4e81-b34a-f6838d781faf req-e17f1b35-af34-4cc7-99b4-33761a7555a8 service nova] Acquiring lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:11:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c08178ef-67c5-4e81-b34a-f6838d781faf req-e17f1b35-af34-4cc7-99b4-33761a7555a8 service nova] Acquired lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:11:57 user nova-compute[82617]: DEBUG nova.network.neutron [req-c08178ef-67c5-4e81-b34a-f6838d781faf req-e17f1b35-af34-4cc7-99b4-33761a7555a8 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Refreshing network info cache for port cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 16:11:57 user nova-compute[82617]: DEBUG nova.network.neutron [req-c08178ef-67c5-4e81-b34a-f6838d781faf req-e17f1b35-af34-4cc7-99b4-33761a7555a8 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updated VIF entry in instance network info cache for port cc92c125-9bd3-4395-a1e6-595bc936b1a3. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 16:11:57 user nova-compute[82617]: DEBUG nova.network.neutron [req-c08178ef-67c5-4e81-b34a-f6838d781faf req-e17f1b35-af34-4cc7-99b4-33761a7555a8 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updating instance_info_cache with network_info: [{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:11:57 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-c08178ef-67c5-4e81-b34a-f6838d781faf req-e17f1b35-af34-4cc7-99b4-33761a7555a8 service nova] Releasing lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:11:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:11:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:11:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:11:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:12:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:12:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8509MB free_disk=26.187042236328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d1695560-531a-4bc2-ba83-0ded0eab8d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:12:06 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:12:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:12:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:12:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:12 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:12 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:12:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:12:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:16 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid d1695560-531a-4bc2-ba83-0ded0eab8d54 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updating instance_info_cache with network_info: [{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:12:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:12:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:12:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:12:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:12:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:12:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:12:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:12:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:12:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:12:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:13:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:13:06 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8525MB free_disk=26.183853149414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d1695560-531a-4bc2-ba83-0ded0eab8d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:13:06 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:13:07 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:13:07 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:13:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:13:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:13:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:13:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:15 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:13:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid d1695560-531a-4bc2-ba83-0ded0eab8d54 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updating instance_info_cache with network_info: [{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:13:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:13:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:24 user nova-compute[82617]: ERROR nova.volume.cinder [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Delete attachment failed for attachment fb44dce3-1af2-43cf-95fa-68ff027e0699. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-c78e09d4-3679-4ee2-ab6c-f8158e1aaa1d) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-c78e09d4-3679-4ee2-ab6c-f8158e1aaa1d)
Apr 17 16:13:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:13:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:13:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:13:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:13:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:13:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:13:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:13:56 user nova-compute[82617]: ERROR nova.volume.cinder [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Delete attachment failed for attachment a68f5fc4-dea3-48a4-bdb0-1d89db356c29. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-625dc9c1-5166-463d-b990-0b1f19b50106) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-625dc9c1-5166-463d-b990-0b1f19b50106)
Apr 17 16:13:56 user nova-compute[82617]: WARNING nova.compute.manager [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Ignoring unknown cinder exception for volume 1072d05f-2ebb-4398-902c-902df25464e9: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-625dc9c1-5166-463d-b990-0b1f19b50106): cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-625dc9c1-5166-463d-b990-0b1f19b50106)
Apr 17 16:13:56 user nova-compute[82617]: INFO nova.compute.manager [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] Took 600.29 seconds to detach 1 volumes for instance.
Apr 17 16:13:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:13:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:13:56 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:13:56 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:13:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:13:56 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Deleted allocations for instance d109f8c3-aed3-45af-ba8d-30b9006ef4e4
Apr 17 16:13:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-008ec7fb-052b-43ae-952b-3c2d087ab270 tempest-ServerActionsTestJSON-645547919 tempest-ServerActionsTestJSON-645547919-project-member] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 662.607s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:13:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 205.467s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:13:56 user nova-compute[82617]: INFO nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d109f8c3-aed3-45af-ba8d-30b9006ef4e4] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 17 16:13:56 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "d109f8c3-aed3-45af-ba8d-30b9006ef4e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:13:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:08 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:14:08 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:14:08 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8508MB free_disk=26.181644439697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d1695560-531a-4bc2-ba83-0ded0eab8d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:14:08 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:14:09 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:14:09 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:14:09 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:14:09 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:14:12 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:14:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:15 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:14:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid d1695560-531a-4bc2-ba83-0ded0eab8d54 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updating instance_info_cache with network_info: [{"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-d1695560-531a-4bc2-ba83-0ded0eab8d54" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:14:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:14:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:14:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:14:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:14:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:37 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:14:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:14:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:14:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:14:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:14:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:15:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:15:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:15:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:15:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:15:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:15:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:15:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:15:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:15:10 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:15:10 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:15:10 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8503MB free_disk=26.169292449951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance d1695560-531a-4bc2-ba83-0ded0eab8d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:15:10 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:15:11 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:15:11 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:15:11 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:15:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:15:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:15:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:15:13 user nova-compute[82617]: INFO nova.compute.manager [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Terminating instance
Apr 17 16:15:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-414e10d1-d107-40b7-833d-38360c0e319a req-11674c4d-7399-45c8-a70b-913137e88183 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received event network-vif-unplugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-414e10d1-d107-40b7-833d-38360c0e319a req-11674c4d-7399-45c8-a70b-913137e88183 service nova] Acquiring lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-414e10d1-d107-40b7-833d-38360c0e319a req-11674c4d-7399-45c8-a70b-913137e88183 service nova] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-414e10d1-d107-40b7-833d-38360c0e319a req-11674c4d-7399-45c8-a70b-913137e88183 service nova] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-414e10d1-d107-40b7-833d-38360c0e319a req-11674c4d-7399-45c8-a70b-913137e88183 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] No waiting events found dispatching network-vif-unplugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.compute.manager [req-414e10d1-d107-40b7-833d-38360c0e319a req-11674c4d-7399-45c8-a70b-913137e88183 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received event network-vif-unplugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 16:15:14 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Instance destroyed successfully.
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lazy-loading 'resources' on Instance uuid d1695560-531a-4bc2-ba83-0ded0eab8d54 {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-60777785',display_name='tempest-AttachVolumeTestJSON-server-60777785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-60777785',id=29,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPC1+6jDt6Hwh/sTiAiEFNhvD6ggy52koIuU368UWYx1Md1npga+0+MndM6LNtALd11qK/GnXjwsvH4m79Bpr4FbBXbkTVcBvXC/DLIA5wJOFy7nWmCwLeQ+KIAl++4jA==',key_name='tempest-keypair-161401027',keypairs=<?>,launch_index=0,launched_at=2023-04-17T16:10:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2eb998c84b5b41e599af9636b929295d',ramdisk_id='',reservation_id='r-xqxh1o9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1193954556',owner_user_name='tempest-AttachVolumeTestJSON-1193954556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T16:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d4a317838b47d6a2a2e7eab7a453dd',uuid=d1695560-531a-4bc2-ba83-0ded0eab8d54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converting VIF {"id": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "address": "fa:16:3e:64:8c:a3", "network": {"id": "e58885d6-3015-43cb-9b63-929490f5cf12", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1409684485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eb998c84b5b41e599af9636b929295d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc92c125-9b", "ovs_interfaceid": "cc92c125-9bd3-4395-a1e6-595bc936b1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:8c:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc92c125-9bd3-4395-a1e6-595bc936b1a3,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc92c125-9b') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG os_vif [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:8c:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc92c125-9bd3-4395-a1e6-595bc936b1a3,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc92c125-9b') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc92c125-9b, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:15:14 user nova-compute[82617]: INFO os_vif [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:8c:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc92c125-9bd3-4395-a1e6-595bc936b1a3,network=Network(e58885d6-3015-43cb-9b63-929490f5cf12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc92c125-9b')
Apr 17 16:15:14 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Deleting instance files /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54_del
Apr 17 16:15:14 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Deletion of /opt/stack/data/nova/instances/d1695560-531a-4bc2-ba83-0ded0eab8d54_del complete
Apr 17 16:15:14 user nova-compute[82617]: INFO nova.compute.manager [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 17 16:15:14 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:15:14 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:15:15 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:15:15 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Took 0.82 seconds to deallocate network for instance.
Apr 17 16:15:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:15:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:15:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-baeb08ae-4f85-49a9-b2bc-4218a2533164 req-5d2c3c40-d3f0-473d-884f-574b75086666 service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received event network-vif-deleted-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:15:15 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:15:15 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:15:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:15:15 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Deleted allocations for instance d1695560-531a-4bc2-ba83-0ded0eab8d54
Apr 17 16:15:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b294d182-d8f6-4740-aa72-4c3754448262 tempest-AttachVolumeTestJSON-1193954556 tempest-AttachVolumeTestJSON-1193954556-project-member] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:15:16 user nova-compute[82617]: DEBUG nova.compute.manager [req-af9d19b1-f1fc-49eb-8f0f-a8a0bcbcafc5 req-22f202b2-4046-4242-b6cb-983cdb47449e service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received event network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:15:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-af9d19b1-f1fc-49eb-8f0f-a8a0bcbcafc5 req-22f202b2-4046-4242-b6cb-983cdb47449e service nova] Acquiring lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:15:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-af9d19b1-f1fc-49eb-8f0f-a8a0bcbcafc5 req-22f202b2-4046-4242-b6cb-983cdb47449e service nova] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:15:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-af9d19b1-f1fc-49eb-8f0f-a8a0bcbcafc5 req-22f202b2-4046-4242-b6cb-983cdb47449e service nova] Lock "d1695560-531a-4bc2-ba83-0ded0eab8d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:15:16 user nova-compute[82617]: DEBUG nova.compute.manager [req-af9d19b1-f1fc-49eb-8f0f-a8a0bcbcafc5 req-22f202b2-4046-4242-b6cb-983cdb47449e service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] No waiting events found dispatching network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:15:16 user nova-compute[82617]: WARNING nova.compute.manager [req-af9d19b1-f1fc-49eb-8f0f-a8a0bcbcafc5 req-22f202b2-4046-4242-b6cb-983cdb47449e service nova] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Received unexpected event network-vif-plugged-cc92c125-9bd3-4395-a1e6-595bc936b1a3 for instance with vm_state deleted and task_state None.
Apr 17 16:15:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:15:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:15:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:15:24 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:15:24 user nova-compute[82617]: ERROR nova.volume.cinder [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Delete attachment failed for attachment fb44dce3-1af2-43cf-95fa-68ff027e0699. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-f2b51132-0b2f-4350-b59e-e65a5d094af4) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-f2b51132-0b2f-4350-b59e-e65a5d094af4)
Apr 17 16:15:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:15:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:29 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681748114.5711336, d1695560-531a-4bc2-ba83-0ded0eab8d54 => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:15:29 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] VM Stopped (Lifecycle Event)
Apr 17 16:15:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-f242034e-6ddf-4687-b4d3-a56ec1090571 None None] [instance: d1695560-531a-4bc2-ba83-0ded0eab8d54] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:15:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:15:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:15:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:15:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:16:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:16:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:16:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:16:11 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:16:11 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=26.183944702148438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:16:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:16:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:16:15 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:15 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:15 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:16:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:16:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:16:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:16:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:16:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:16:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:16:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:16:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:16:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:16:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:16:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:16:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:16:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:16:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:17:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:17:13 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:17:13 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:17:13 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8595MB free_disk=26.181415557861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:17:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:17:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:17:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:17:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:24 user nova-compute[82617]: ERROR nova.volume.cinder [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Delete attachment failed for attachment fb44dce3-1af2-43cf-95fa-68ff027e0699. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-0a3ae49c-837d-4b32-a241-6c27a7c860b1) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-0a3ae49c-837d-4b32-a241-6c27a7c860b1)
Apr 17 16:17:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:17:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:17:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:17:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:17:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:17:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:17:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:17:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:17:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:17:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:17:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:17:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:17:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:18:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:18:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:18:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:18:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:18:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:18:14 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:18:14 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:18:14 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=26.169879913330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:18:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:18:18 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:18 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:18:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:18:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:18:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:18:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:18:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:18:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:18:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:18:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:18:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:18:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:18:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:18:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:18:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:19:16 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:19:16 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:19:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8585MB free_disk=26.15053939819336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:19:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:19:18 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:18 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:19:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:19:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:21 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:24 user nova-compute[82617]: ERROR nova.volume.cinder [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Delete attachment failed for attachment fb44dce3-1af2-43cf-95fa-68ff027e0699. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-6b192c03-a049-4336-94b1-1dc0169da47f) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-6b192c03-a049-4336-94b1-1dc0169da47f)
Apr 17 16:19:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:19:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:19:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:19:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:19:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:19:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:19:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:19:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:19:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:20:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:20:13 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:20:16 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:20:16 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:20:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8626MB free_disk=26.139652252197266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:20:16 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:20:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:19 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:20:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:20:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:20:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:20:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Skipping network cache update for instance because it is being deleted. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 17 16:20:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:20:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:20:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:20:39 user nova-compute[82617]: WARNING nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] While synchronizing instance power states, found 1 instances in the database and 0 instances on the hypervisor.
Apr 17 16:20:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Sync already in progress for fc3385ee-a569-4a45-812b-b9073d774535 {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10200}}
Apr 17 16:20:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:20:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:20:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:21:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:21:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:21:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:21:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:21:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:21:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:21:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:21:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:21:17 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:21:17 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8641MB free_disk=26.13745880126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance fc3385ee-a569-4a45-812b-b9073d774535 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:21:17 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:21:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:21:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:20 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:21:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:21:25 user nova-compute[82617]: ERROR nova.volume.cinder [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Delete attachment failed for attachment fb44dce3-1af2-43cf-95fa-68ff027e0699. Error: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-59119c1f-bf48-411e-9d13-48936b29a9e6) Code: 500: cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-59119c1f-bf48-411e-9d13-48936b29a9e6)
Apr 17 16:21:25 user nova-compute[82617]: WARNING nova.compute.manager [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Ignoring unknown cinder exception for volume 32819ec1-2236-465f-a1c7-ee31aa4a0911: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-59119c1f-bf48-411e-9d13-48936b29a9e6): cinderclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-59119c1f-bf48-411e-9d13-48936b29a9e6)
Apr 17 16:21:25 user nova-compute[82617]: INFO nova.compute.manager [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] [instance: fc3385ee-a569-4a45-812b-b9073d774535] Took 600.84 seconds to detach 1 volumes for instance.
Apr 17 16:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:21:25 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:21:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:21:25 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Deleted allocations for instance fc3385ee-a569-4a45-812b-b9073d774535
Apr 17 16:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-bb0706f3-0b2c-473a-acc5-93c2ac742a5f tempest-ServerStableDeviceRescueTest-869290889 tempest-ServerStableDeviceRescueTest-869290889-project-member] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 662.058s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 653.878s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:21:25 user nova-compute[82617]: INFO nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: fc3385ee-a569-4a45-812b-b9073d774535] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 17 16:21:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "fc3385ee-a569-4a45-812b-b9073d774535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:21:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:21:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:31 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:21:31 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:21:31 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:21:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:21:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:21:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:21:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:21:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:21:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:21:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:22:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:22:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:22:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:22:19 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:22:19 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:22:19 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=26.12326431274414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:22:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:22:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:22:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:22:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:22:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:22:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:22:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:22:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:22:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:22:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:22:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:22:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:22:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:22:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:22:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:22:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:22:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:22:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:22:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:23:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:23:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:23:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:23:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:23:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:23:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:23:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:23:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:23:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:23:20 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:23:20 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:23:20 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=26.121139526367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:23:20 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:23:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:23:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:23:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:23:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:23:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:23:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:23:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:23:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:23:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:23:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:23:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:23:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:23:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:24:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:24:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:24:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:24:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:24:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:24:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:24:21 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:24:21 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:24:21 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8618MB free_disk=26.119003295898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:24:21 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:24:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:22 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:22 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:24:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:24:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:24:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:24:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:24:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:24:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:24:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:24:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:24:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:24:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:24:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:24:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:24:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:24:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:24:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:24:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:25:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:25:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:25:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:25:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:21 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:25:21 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:25:23 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:25:23 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:25:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=26.106342315673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:25:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:25:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:25:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:25:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:30 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:25:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:25:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:25:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:25:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:25:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:25:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:25:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:25:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:26:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:26:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:26:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:26:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:26:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:26:23 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:26:23 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8672MB free_disk=26.10451889038086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:26:23 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:26:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:25 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:26:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:26:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:26:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:26:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:26:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:26:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:26:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:26:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:26:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:26:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:26:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:26:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:26:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:27:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:23 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:27:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:27:24 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:27:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=26.102771759033203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:27:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:27:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:27:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:27:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:27:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:27:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:27:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:27:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:27:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:28:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:28:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:28:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:28:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:28:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:28:24 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:28:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:28:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:28:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=26.088973999023438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:28:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:28:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:28:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:28:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:28:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:28:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:28:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:28:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:28:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:29:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:29:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:29:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:29:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:29:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:29:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:29:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:29:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=26.08734893798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:29:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:29:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:29:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:29:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:34 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:29:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:29:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:29:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:29:39 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:29:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:29:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:29:49 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:29:54 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:29:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:04 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:09 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:19 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:30:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:30:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:30:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8652MB free_disk=26.085792541503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:30:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:30:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:30:26 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:30:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:27 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:30:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:29 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:30:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:30:39 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:30:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:30:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:30:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:30:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:30:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:30:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:30:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:30:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:30:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:30:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:31:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:31:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:31:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:31:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:31:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:31:16 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:31:25 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8652MB free_disk=26.08279800415039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:31:25 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:31:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:29 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:31:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:31:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:31:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:31:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:31:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:31:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:31:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:31:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:31:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:31:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:31:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:31:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:31:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:32:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:32:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:32:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:32:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:32:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:32:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:32:26 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:32:26 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:32:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=26.080108642578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:32:26 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:32:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:32:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:31 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:32:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:32:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:32:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:32:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:32:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:32:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:32:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:32:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:32:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:32:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:32:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:32:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:32:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:32:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:33:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:33:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:33:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:33:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:33:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:33:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:33:27 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:33:27 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:33:27 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=26.06283187866211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:33:27 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:33:29 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:31 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:33:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:33:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:33:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:33:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:33:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:33:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:33:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:33:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:33:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:33:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:33:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:33:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:33:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:33:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:34:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:34:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:34:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:34:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:34:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:34:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:34:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:34:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=26.06116485595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:34:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:34:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:34:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:34:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:34:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:34:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:34:44 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:34:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:34:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:34:53 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:34:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:34:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:35:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:35:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:35:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:35:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:35:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:35:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=26.04928207397461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:35:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:35:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:35:32 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:35:33 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:34 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:35:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:35:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:35:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:35:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:35:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:35:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:35:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:35:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:35:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:35:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:35:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:35:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:35:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:35:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:35:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:35:54 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:54 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:35:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:35:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:35:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:36:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:36:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:36:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:36:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:36:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:36:28 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=26.047637939453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:36:28 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:36:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:35 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:36:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:36:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:36:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:36:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:36:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:36:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:36:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:36:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:36:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:36:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:36:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:36:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:36:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:36:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:36:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:36:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:36:57 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:37:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:37:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:37:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:37:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:37:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:37:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:37:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:37:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:37:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:37:25 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:37:30 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:37:30 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:37:30 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=26.046096801757812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:37:30 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:37:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:37:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:36 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:37:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:37:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:37:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:37:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:37:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:37:50 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:37:51 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:37:55 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:37:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:37:59 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:01 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:05 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:07 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:10 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Starting instance... {{(pid=82617) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82617) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 17 16:38:11 user nova-compute[82617]: INFO nova.compute.claims [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Claim successful on node user
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Start building networks asynchronously for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Allocating IP information in the background. {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] allocate_for_instance() {{(pid=82617) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 17 16:38:11 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Start building block device mappings for instance. {{(pid=82617) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Start spawning the instance on the hypervisor. {{(pid=82617) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Creating instance directory {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 17 16:38:11 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Creating image(s)
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "/opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "/opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "/opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG nova.policy [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8c0fb3f72494a489e0230e83a85224a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9277ba8f5f4f9abcbb70ee01b22d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82617) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:11 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.140s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk 1073741824 {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832,backing_fmt=raw /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk 1073741824" returned: 0 in 0.047s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "eedfa34839e79fc35bb134fcbcf55f7451ef2832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832 --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk. size=1073741824 {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG nova.virt.disk.api [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Cannot resize image /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk to a smaller size. {{(pid=82617) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lazy-loading 'migration_context' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Created local disks {{(pid=82617) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Ensure instance console log exists: /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/console.log {{(pid=82617) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:12 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Successfully created port: e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Successfully updated port: e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Building network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Instance cache missing network info. {{(pid=82617) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-7b02e4c0-9155-4078-be9b-554cfbca09e9 req-a64e7a59-499a-4efe-adbe-1c08c2c2fc15 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received event network-changed-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.compute.manager [req-7b02e4c0-9155-4078-be9b-554cfbca09e9 req-a64e7a59-499a-4efe-adbe-1c08c2c2fc15 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Refreshing instance network info cache due to event network-changed-e915f7f8-96fd-40b1-a868-66ce5c5edd1a. {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7b02e4c0-9155-4078-be9b-554cfbca09e9 req-a64e7a59-499a-4efe-adbe-1c08c2c2fc15 service nova] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Instance network_info: |[{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82617) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7b02e4c0-9155-4078-be9b-554cfbca09e9 req-a64e7a59-499a-4efe-adbe-1c08c2c2fc15 service nova] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.neutron [req-7b02e4c0-9155-4078-be9b-554cfbca09e9 req-a64e7a59-499a-4efe-adbe-1c08c2c2fc15 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Refreshing network info cache for port e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Start _get_guest_xml network_info=[{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'b3f0dec1-7758-44a8-82e0-76ada8837428'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 17 16:38:13 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:38:13 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82617) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-17T15:21:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-17T15:19:53Z,direct_url=<?>,disk_format='qcow2',id=b3f0dec1-7758-44a8-82e0-76ada8837428,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='a43c211b4ed542538799349489b1d884',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-17T15:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Flavor limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Image limits 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Flavor pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Image pref 0:0:0 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Got 1 possible topologies {{(pid=82617) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.hardware [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82617) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-174226204',display_name='tempest-SnapshotDataIntegrityTests-server-174226204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-174226204',id=30,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAG/Jn2J8WXoSHzeukXQ6+rWMnsvTyn/QhCwKvBv4mY56w9d/Rr2cmpY4ecrqNTTLOVblLXl0HRhskEOBYNupvPSSAcC3KZZ+l6/1UMKcEz/7cKDOFvmU8ZUnmrtPbRDQ==',key_name='tempest-SnapshotDataIntegrityTests-257435708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a9277ba8f5f4f9abcbb70ee01b22d41',ramdisk_id='',reservation_id='r-u7zf26el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-793909213',owner_user_name='tempest-SnapshotDataIntegrityTests-793909213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T16:38:12Z,user_data=None,user_id='d8c0fb3f72494a489e0230e83a85224a',uuid=87b80d6e-3ebc-46c6-b674-46c55367c3fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82617) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Converting VIF {"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=e915f7f8-96fd-40b1-a868-66ce5c5edd1a,network=Network(02f1e4a4-3788-4e15-acba-bf1df50588b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape915f7f8-96') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lazy-loading 'pci_devices' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] End _get_guest_xml xml=<domain type="kvm">
Apr 17 16:38:13 user nova-compute[82617]:   <uuid>87b80d6e-3ebc-46c6-b674-46c55367c3fd</uuid>
Apr 17 16:38:13 user nova-compute[82617]:   <name>instance-0000001e</name>
Apr 17 16:38:13 user nova-compute[82617]:   <memory>131072</memory>
Apr 17 16:38:13 user nova-compute[82617]:   <vcpu>1</vcpu>
Apr 17 16:38:13 user nova-compute[82617]:   <metadata>
Apr 17 16:38:13 user nova-compute[82617]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 17 16:38:13 user nova-compute[82617]:       <nova:package version="0.0.0"/>
Apr 17 16:38:13 user nova-compute[82617]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-174226204</nova:name>
Apr 17 16:38:13 user nova-compute[82617]:       <nova:creationTime>2023-04-17 16:38:13</nova:creationTime>
Apr 17 16:38:13 user nova-compute[82617]:       <nova:flavor name="m1.nano">
Apr 17 16:38:13 user nova-compute[82617]:         <nova:memory>128</nova:memory>
Apr 17 16:38:13 user nova-compute[82617]:         <nova:disk>1</nova:disk>
Apr 17 16:38:13 user nova-compute[82617]:         <nova:swap>0</nova:swap>
Apr 17 16:38:13 user nova-compute[82617]:         <nova:ephemeral>0</nova:ephemeral>
Apr 17 16:38:13 user nova-compute[82617]:         <nova:vcpus>1</nova:vcpus>
Apr 17 16:38:13 user nova-compute[82617]:       </nova:flavor>
Apr 17 16:38:13 user nova-compute[82617]:       <nova:owner>
Apr 17 16:38:13 user nova-compute[82617]:         <nova:user uuid="d8c0fb3f72494a489e0230e83a85224a">tempest-SnapshotDataIntegrityTests-793909213-project-member</nova:user>
Apr 17 16:38:13 user nova-compute[82617]:         <nova:project uuid="2a9277ba8f5f4f9abcbb70ee01b22d41">tempest-SnapshotDataIntegrityTests-793909213</nova:project>
Apr 17 16:38:13 user nova-compute[82617]:       </nova:owner>
Apr 17 16:38:13 user nova-compute[82617]:       <nova:root type="image" uuid="b3f0dec1-7758-44a8-82e0-76ada8837428"/>
Apr 17 16:38:13 user nova-compute[82617]:       <nova:ports>
Apr 17 16:38:13 user nova-compute[82617]:         <nova:port uuid="e915f7f8-96fd-40b1-a868-66ce5c5edd1a">
Apr 17 16:38:13 user nova-compute[82617]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 17 16:38:13 user nova-compute[82617]:         </nova:port>
Apr 17 16:38:13 user nova-compute[82617]:       </nova:ports>
Apr 17 16:38:13 user nova-compute[82617]:     </nova:instance>
Apr 17 16:38:13 user nova-compute[82617]:   </metadata>
Apr 17 16:38:13 user nova-compute[82617]:   <sysinfo type="smbios">
Apr 17 16:38:13 user nova-compute[82617]:     <system>
Apr 17 16:38:13 user nova-compute[82617]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 17 16:38:13 user nova-compute[82617]:       <entry name="product">OpenStack Nova</entry>
Apr 17 16:38:13 user nova-compute[82617]:       <entry name="version">0.0.0</entry>
Apr 17 16:38:13 user nova-compute[82617]:       <entry name="serial">87b80d6e-3ebc-46c6-b674-46c55367c3fd</entry>
Apr 17 16:38:13 user nova-compute[82617]:       <entry name="uuid">87b80d6e-3ebc-46c6-b674-46c55367c3fd</entry>
Apr 17 16:38:13 user nova-compute[82617]:       <entry name="family">Virtual Machine</entry>
Apr 17 16:38:13 user nova-compute[82617]:     </system>
Apr 17 16:38:13 user nova-compute[82617]:   </sysinfo>
Apr 17 16:38:13 user nova-compute[82617]:   <os>
Apr 17 16:38:13 user nova-compute[82617]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 17 16:38:13 user nova-compute[82617]:     <boot dev="hd"/>
Apr 17 16:38:13 user nova-compute[82617]:     <smbios mode="sysinfo"/>
Apr 17 16:38:13 user nova-compute[82617]:   </os>
Apr 17 16:38:13 user nova-compute[82617]:   <features>
Apr 17 16:38:13 user nova-compute[82617]:     <acpi/>
Apr 17 16:38:13 user nova-compute[82617]:     <apic/>
Apr 17 16:38:13 user nova-compute[82617]:     <vmcoreinfo/>
Apr 17 16:38:13 user nova-compute[82617]:   </features>
Apr 17 16:38:13 user nova-compute[82617]:   <clock offset="utc">
Apr 17 16:38:13 user nova-compute[82617]:     <timer name="pit" tickpolicy="delay"/>
Apr 17 16:38:13 user nova-compute[82617]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 17 16:38:13 user nova-compute[82617]:     <timer name="hpet" present="no"/>
Apr 17 16:38:13 user nova-compute[82617]:   </clock>
Apr 17 16:38:13 user nova-compute[82617]:   <cpu mode="custom" match="exact">
Apr 17 16:38:13 user nova-compute[82617]:     <model>Nehalem</model>
Apr 17 16:38:13 user nova-compute[82617]:     <topology sockets="1" cores="1" threads="1"/>
Apr 17 16:38:13 user nova-compute[82617]:   </cpu>
Apr 17 16:38:13 user nova-compute[82617]:   <devices>
Apr 17 16:38:13 user nova-compute[82617]:     <disk type="file" device="disk">
Apr 17 16:38:13 user nova-compute[82617]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 17 16:38:13 user nova-compute[82617]:       <source file="/opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk"/>
Apr 17 16:38:13 user nova-compute[82617]:       <target dev="vda" bus="virtio"/>
Apr 17 16:38:13 user nova-compute[82617]:     </disk>
Apr 17 16:38:13 user nova-compute[82617]:     <interface type="ethernet">
Apr 17 16:38:13 user nova-compute[82617]:       <mac address="fa:16:3e:19:47:f7"/>
Apr 17 16:38:13 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 16:38:13 user nova-compute[82617]:       <mtu size="1442"/>
Apr 17 16:38:13 user nova-compute[82617]:       <target dev="tape915f7f8-96"/>
Apr 17 16:38:13 user nova-compute[82617]:     </interface>
Apr 17 16:38:13 user nova-compute[82617]:     <serial type="pty">
Apr 17 16:38:13 user nova-compute[82617]:       <log file="/opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/console.log" append="off"/>
Apr 17 16:38:13 user nova-compute[82617]:     </serial>
Apr 17 16:38:13 user nova-compute[82617]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 17 16:38:13 user nova-compute[82617]:     <video>
Apr 17 16:38:13 user nova-compute[82617]:       <model type="virtio"/>
Apr 17 16:38:13 user nova-compute[82617]:     </video>
Apr 17 16:38:13 user nova-compute[82617]:     <rng model="virtio">
Apr 17 16:38:13 user nova-compute[82617]:       <backend model="random">/dev/urandom</backend>
Apr 17 16:38:13 user nova-compute[82617]:     </rng>
Apr 17 16:38:13 user nova-compute[82617]:     <controller type="usb" index="0" model="none"/>
Apr 17 16:38:13 user nova-compute[82617]:     <memballoon model="virtio">
Apr 17 16:38:13 user nova-compute[82617]:       <stats period="10"/>
Apr 17 16:38:13 user nova-compute[82617]:     </memballoon>
Apr 17 16:38:13 user nova-compute[82617]:   </devices>
Apr 17 16:38:13 user nova-compute[82617]: </domain>
Apr 17 16:38:13 user nova-compute[82617]:  {{(pid=82617) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-174226204',display_name='tempest-SnapshotDataIntegrityTests-server-174226204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-174226204',id=30,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAG/Jn2J8WXoSHzeukXQ6+rWMnsvTyn/QhCwKvBv4mY56w9d/Rr2cmpY4ecrqNTTLOVblLXl0HRhskEOBYNupvPSSAcC3KZZ+l6/1UMKcEz/7cKDOFvmU8ZUnmrtPbRDQ==',key_name='tempest-SnapshotDataIntegrityTests-257435708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a9277ba8f5f4f9abcbb70ee01b22d41',ramdisk_id='',reservation_id='r-u7zf26el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-793909213',owner_user_name='tempest-SnapshotDataIntegrityTests-793909213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-17T16:38:12Z,user_data=None,user_id='d8c0fb3f72494a489e0230e83a85224a',uuid=87b80d6e-3ebc-46c6-b674-46c55367c3fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Converting VIF {"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=e915f7f8-96fd-40b1-a868-66ce5c5edd1a,network=Network(02f1e4a4-3788-4e15-acba-bf1df50588b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape915f7f8-96') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG os_vif [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=e915f7f8-96fd-40b1-a868-66ce5c5edd1a,network=Network(02f1e4a4-3788-4e15-acba-bf1df50588b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape915f7f8-96') {{(pid=82617) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape915f7f8-96, may_exist=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape915f7f8-96, col_values=(('external_ids', {'iface-id': 'e915f7f8-96fd-40b1-a868-66ce5c5edd1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:47:f7', 'vm-uuid': '87b80d6e-3ebc-46c6-b674-46c55367c3fd'}),)) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:13 user nova-compute[82617]: INFO os_vif [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=e915f7f8-96fd-40b1-a868-66ce5c5edd1a,network=Network(02f1e4a4-3788-4e15-acba-bf1df50588b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape915f7f8-96')
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] No BDM found with device name vda, not building metadata. {{(pid=82617) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 17 16:38:13 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] No VIF found with MAC fa:16:3e:19:47:f7, not building metadata {{(pid=82617) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 17 16:38:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-7b02e4c0-9155-4078-be9b-554cfbca09e9 req-a64e7a59-499a-4efe-adbe-1c08c2c2fc15 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated VIF entry in instance network info cache for port e915f7f8-96fd-40b1-a868-66ce5c5edd1a. {{(pid=82617) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 17 16:38:14 user nova-compute[82617]: DEBUG nova.network.neutron [req-7b02e4c0-9155-4078-be9b-554cfbca09e9 req-a64e7a59-499a-4efe-adbe-1c08c2c2fc15 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:38:14 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-7b02e4c0-9155-4078-be9b-554cfbca09e9 req-a64e7a59-499a-4efe-adbe-1c08c2c2fc15 service nova] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:38:14 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-2b5def12-cf9d-4b79-9267-79c04e2db883 req-bf5eef41-e5bb-478e-9656-0cd3faaee2ea service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received event network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2b5def12-cf9d-4b79-9267-79c04e2db883 req-bf5eef41-e5bb-478e-9656-0cd3faaee2ea service nova] Acquiring lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2b5def12-cf9d-4b79-9267-79c04e2db883 req-bf5eef41-e5bb-478e-9656-0cd3faaee2ea service nova] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-2b5def12-cf9d-4b79-9267-79c04e2db883 req-bf5eef41-e5bb-478e-9656-0cd3faaee2ea service nova] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG nova.compute.manager [req-2b5def12-cf9d-4b79-9267-79c04e2db883 req-bf5eef41-e5bb-478e-9656-0cd3faaee2ea service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] No waiting events found dispatching network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:38:15 user nova-compute[82617]: WARNING nova.compute.manager [req-2b5def12-cf9d-4b79-9267-79c04e2db883 req-bf5eef41-e5bb-478e-9656-0cd3faaee2ea service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received unexpected event network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a for instance with vm_state building and task_state spawning.
Apr 17 16:38:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:15 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681749497.041583, 87b80d6e-3ebc-46c6-b674-46c55367c3fd => Resumed> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:38:17 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] VM Resumed (Lifecycle Event)
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Instance event wait completed in 0 seconds for  {{(pid=82617) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Guest created on hypervisor {{(pid=82617) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 17 16:38:17 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Instance spawned successfully.
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Found default for hw_cdrom_bus of ide {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Found default for hw_disk_bus of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Found default for hw_input_bus of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Found default for hw_pointer_model of None {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Found default for hw_video_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.libvirt.driver [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Found default for hw_vif_model of virtio {{(pid=82617) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 17 16:38:17 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.virt.driver [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] Emitting event <LifecycleEvent: 1681749497.043939, 87b80d6e-3ebc-46c6-b674-46c55367c3fd => Started> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:38:17 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] VM Started (Lifecycle Event)
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82617) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 17 16:38:17 user nova-compute[82617]: INFO nova.compute.manager [None req-42b58c4e-750d-40cd-9fdb-cabe22ab9362 None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 17 16:38:17 user nova-compute[82617]: INFO nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Took 5.43 seconds to spawn the instance on the hypervisor.
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:38:17 user nova-compute[82617]: INFO nova.compute.manager [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Took 6.03 seconds to build instance.
Apr 17 16:38:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b17c7e36-7924-4005-bf1f-137000c5c9f2 tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.125s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-15e75fc9-3896-4c7d-af09-a9853f5dc6e8 req-2de5550f-29b7-4aa6-9b96-20be40813185 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received event network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-15e75fc9-3896-4c7d-af09-a9853f5dc6e8 req-2de5550f-29b7-4aa6-9b96-20be40813185 service nova] Acquiring lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-15e75fc9-3896-4c7d-af09-a9853f5dc6e8 req-2de5550f-29b7-4aa6-9b96-20be40813185 service nova] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-15e75fc9-3896-4c7d-af09-a9853f5dc6e8 req-2de5550f-29b7-4aa6-9b96-20be40813185 service nova] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:17 user nova-compute[82617]: DEBUG nova.compute.manager [req-15e75fc9-3896-4c7d-af09-a9853f5dc6e8 req-2de5550f-29b7-4aa6-9b96-20be40813185 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] No waiting events found dispatching network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:38:17 user nova-compute[82617]: WARNING nova.compute.manager [req-15e75fc9-3896-4c7d-af09-a9853f5dc6e8 req-2de5550f-29b7-4aa6-9b96-20be40813185 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received unexpected event network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a for instance with vm_state active and task_state None.
Apr 17 16:38:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:20 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:38:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:38:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:38:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:38:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:30 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:31 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:38:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:38:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:38:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8527MB free_disk=26.014869689941406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:38:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:38:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:38:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:38:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:38:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:38:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:35 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:38:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:40 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:45 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:38:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:38:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:38:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:38:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:38:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:00 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:39:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:39:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:39:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:39:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:39:32 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:39:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=26.013774871826172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:39:32 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:39:33 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:39:33 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:39:33 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:39:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:39:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:36 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:37 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:39:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:39:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:39:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:39:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:39:46 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:39:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:39:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:39:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:39:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:39:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:39:58 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:39:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:40:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:40:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:40:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:40:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:40:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:40:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:40:34 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:40:34 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:40:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=26.012630462646484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:40:34 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:40:35 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:40:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:40:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:38 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:40:41 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:41 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Triggering sync for uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 17 16:40:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:40:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:40:42 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:40:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:40:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:40:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:40:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:40:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:40:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:40:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:40:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:40:59 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:01 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:03 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:41:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:41:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.002s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Verify base images {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Image id b3f0dec1-7758-44a8-82e0-76ada8837428 yields fingerprint eedfa34839e79fc35bb134fcbcf55f7451ef2832 {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 17 16:41:12 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] image b3f0dec1-7758-44a8-82e0-76ada8837428 at (/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832): checking
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] image b3f0dec1-7758-44a8-82e0-76ada8837428 at (/opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832): image is in use {{(pid=82617) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] 87b80d6e-3ebc-46c6-b674-46c55367c3fd is a valid instance name {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] 87b80d6e-3ebc-46c6-b674-46c55367c3fd has a disk file {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd is backed by eedfa34839e79fc35bb134fcbcf55f7451ef2832 {{(pid=82617) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 17 16:41:12 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a
Apr 17 16:41:12 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550
Apr 17 16:41:12 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d
Apr 17 16:41:12 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592
Apr 17 16:41:12 user nova-compute[82617]: WARNING nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Unknown base file: /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd
Apr 17 16:41:12 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Active base files: /opt/stack/data/nova/instances/_base/eedfa34839e79fc35bb134fcbcf55f7451ef2832
Apr 17 16:41:12 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Removable base files: /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550 /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592 /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd
Apr 17 16:41:12 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/96c287f73cf0bc2389118e3770917f150e54012a
Apr 17 16:41:12 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c58d517b41d1ba2554adb627419ef5085ab0f550
Apr 17 16:41:12 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d6c931bbcf08b23c92b79cdff5102f1d136633d
Apr 17 16:41:12 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0e43c5e180df8f4cfa642804eda3b2378b95c592
Apr 17 16:41:12 user nova-compute[82617]: INFO nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6082e32daf529637a751c82e6b79b6e611bd90dd
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Verification complete {{(pid=82617) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Verify swap images {{(pid=82617) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 17 16:41:12 user nova-compute[82617]: DEBUG nova.virt.libvirt.imagecache [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Verify ephemeral images {{(pid=82617) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 17 16:41:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:41:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:24 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:41:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:35 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:41:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:41:36 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=26.01131820678711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:41:36 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:41:37 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:41:37 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:41:37 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:41:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:41:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:41:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:41:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:41:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:41:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:41:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:41:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:41:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:41:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:41:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:00 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:42:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:42:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:42:37 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:42:37 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:42:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=26.010345458984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:42:37 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:42:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:40 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:42:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:42:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:42:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:42:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:42:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:42:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:43:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:11 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:43:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:43:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:43:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:43:38 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:43:38 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:43:38 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8664MB free_disk=26.00937271118164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:43:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:43:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:43:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:43:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:43:39 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:43:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:43:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:43:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:43:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:42 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:43:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:43:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:43:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:43:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:43:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:43:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:43:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:43:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:43:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:43:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:43:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:43:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:44:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:44:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:44:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:44:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:44:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:44:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:44:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:44:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:44:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:44:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:44:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:44:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:44:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=26.0084228515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:44:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:44:42 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:43 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:44:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:44:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:44:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:44:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:44:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:44:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:50 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:44:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:44:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:44:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:02 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:45:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:45:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:45:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:09 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:45:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:45:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:45:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:45:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:45:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:45:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:45:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:45:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:45:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.processutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82617) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 17 16:45:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:45:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:45:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=25.99968719482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82617) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:45:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:45:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:44 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:45:46 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquired lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Forcefully refreshing network info cache for instance {{(pid=82617) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG nova.objects.instance [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lazy-loading 'info_cache' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG nova.network.neutron [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [{"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Releasing lock "refresh_cache-87b80d6e-3ebc-46c6-b674-46c55367c3fd" {{(pid=82617) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updated the network info_cache for instance {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 17 16:45:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:45:55 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:45:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 17 16:45:55 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] There are 0 instances to clean {{(pid=82617) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 17 16:45:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:03 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:08 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:08 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82617) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 17 16:46:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:46:33 user nova-compute[82617]: INFO nova.compute.manager [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Terminating instance
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.compute.manager [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Start destroying the instance on the hypervisor. {{(pid=82617) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-56480d71-f283-4421-b2f0-313d13528139 req-368782d7-a82c-4cd1-84ed-268d64007a51 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received event network-vif-unplugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-56480d71-f283-4421-b2f0-313d13528139 req-368782d7-a82c-4cd1-84ed-268d64007a51 service nova] Acquiring lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-56480d71-f283-4421-b2f0-313d13528139 req-368782d7-a82c-4cd1-84ed-268d64007a51 service nova] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-56480d71-f283-4421-b2f0-313d13528139 req-368782d7-a82c-4cd1-84ed-268d64007a51 service nova] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-56480d71-f283-4421-b2f0-313d13528139 req-368782d7-a82c-4cd1-84ed-268d64007a51 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] No waiting events found dispatching network-vif-unplugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.compute.manager [req-56480d71-f283-4421-b2f0-313d13528139 req-368782d7-a82c-4cd1-84ed-268d64007a51 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received event network-vif-unplugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a for instance with task_state deleting. {{(pid=82617) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:33 user nova-compute[82617]: INFO nova.virt.libvirt.driver [-] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Instance destroyed successfully.
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.objects.instance [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lazy-loading 'resources' on Instance uuid 87b80d6e-3ebc-46c6-b674-46c55367c3fd {{(pid=82617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.virt.libvirt.vif [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-17T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-174226204',display_name='tempest-SnapshotDataIntegrityTests-server-174226204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-174226204',id=30,image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAG/Jn2J8WXoSHzeukXQ6+rWMnsvTyn/QhCwKvBv4mY56w9d/Rr2cmpY4ecrqNTTLOVblLXl0HRhskEOBYNupvPSSAcC3KZZ+l6/1UMKcEz/7cKDOFvmU8ZUnmrtPbRDQ==',key_name='tempest-SnapshotDataIntegrityTests-257435708',keypairs=<?>,launch_index=0,launched_at=2023-04-17T16:38:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a9277ba8f5f4f9abcbb70ee01b22d41',ramdisk_id='',reservation_id='r-u7zf26el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3f0dec1-7758-44a8-82e0-76ada8837428',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-793909213',owner_user_name='tempest-SnapshotDataIntegrityTests-793909213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-17T16:38:17Z,user_data=None,user_id='d8c0fb3f72494a489e0230e83a85224a',uuid=87b80d6e-3ebc-46c6-b674-46c55367c3fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Converting VIF {"id": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "address": "fa:16:3e:19:47:f7", "network": {"id": "02f1e4a4-3788-4e15-acba-bf1df50588b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-565095843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a9277ba8f5f4f9abcbb70ee01b22d41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape915f7f8-96", "ovs_interfaceid": "e915f7f8-96fd-40b1-a868-66ce5c5edd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.network.os_vif_util [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=e915f7f8-96fd-40b1-a868-66ce5c5edd1a,network=Network(02f1e4a4-3788-4e15-acba-bf1df50588b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape915f7f8-96') {{(pid=82617) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG os_vif [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=e915f7f8-96fd-40b1-a868-66ce5c5edd1a,network=Network(02f1e4a4-3788-4e15-acba-bf1df50588b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape915f7f8-96') {{(pid=82617) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape915f7f8-96, bridge=br-int, if_exists=True) {{(pid=82617) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:33 user nova-compute[82617]: INFO os_vif [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=e915f7f8-96fd-40b1-a868-66ce5c5edd1a,network=Network(02f1e4a4-3788-4e15-acba-bf1df50588b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape915f7f8-96')
Apr 17 16:46:33 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Deleting instance files /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd_del
Apr 17 16:46:33 user nova-compute[82617]: INFO nova.virt.libvirt.driver [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Deletion of /opt/stack/data/nova/instances/87b80d6e-3ebc-46c6-b674-46c55367c3fd_del complete
Apr 17 16:46:33 user nova-compute[82617]: INFO nova.compute.manager [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 17 16:46:33 user nova-compute[82617]: DEBUG oslo.service.loopingcall [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82617) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.compute.manager [-] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Deallocating network for instance {{(pid=82617) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 17 16:46:33 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] deallocate_for_instance() {{(pid=82617) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG nova.network.neutron [-] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Updating instance_info_cache with network_info: [] {{(pid=82617) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 17 16:46:35 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Took 1.18 seconds to deallocate network for instance.
Apr 17 16:46:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-4a9e6ffd-36db-4238-8e9c-e1a05182cf95 req-2cbfd9d0-5937-41a2-8102-e6be5696029b service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received event network-vif-deleted-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:46:35 user nova-compute[82617]: INFO nova.scheduler.client.report [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Deleted allocations for instance 87b80d6e-3ebc-46c6-b674-46c55367c3fd
Apr 17 16:46:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-dab6a9c2-a8b0-4f81-bf23-cca0ca8786ff tempest-SnapshotDataIntegrityTests-793909213 tempest-SnapshotDataIntegrityTests-793909213-project-member] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.187s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-8e895ef5-e40b-4562-bf5b-a5e57e3fa2b6 req-38c8f286-dda6-4b3d-8892-1a23acf70423 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received event network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8e895ef5-e40b-4562-bf5b-a5e57e3fa2b6 req-38c8f286-dda6-4b3d-8892-1a23acf70423 service nova] Acquiring lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8e895ef5-e40b-4562-bf5b-a5e57e3fa2b6 req-38c8f286-dda6-4b3d-8892-1a23acf70423 service nova] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [req-8e895ef5-e40b-4562-bf5b-a5e57e3fa2b6 req-38c8f286-dda6-4b3d-8892-1a23acf70423 service nova] Lock "87b80d6e-3ebc-46c6-b674-46c55367c3fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:46:35 user nova-compute[82617]: DEBUG nova.compute.manager [req-8e895ef5-e40b-4562-bf5b-a5e57e3fa2b6 req-38c8f286-dda6-4b3d-8892-1a23acf70423 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] No waiting events found dispatching network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a {{(pid=82617) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 17 16:46:35 user nova-compute[82617]: WARNING nova.compute.manager [req-8e895ef5-e40b-4562-bf5b-a5e57e3fa2b6 req-38c8f286-dda6-4b3d-8892-1a23acf70423 service nova] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Received unexpected event network-vif-plugged-e915f7f8-96fd-40b1-a868-66ce5c5edd1a for instance with vm_state deleted and task_state None.
Apr 17 16:46:38 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:46:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:46:39 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=26.01844024658203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing inventories for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating ProviderTree inventory for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Updating inventory in ProviderTree for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing aggregate associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, aggregates: None {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Refreshing trait associations for resource provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=82617) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:46:39 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:46:43 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:46:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:46:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:46:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:45 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:45 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:46:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:48 user nova-compute[82617]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681749993.8794968, 87b80d6e-3ebc-46c6-b674-46c55367c3fd => Stopped> {{(pid=82617) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 17 16:46:48 user nova-compute[82617]: INFO nova.compute.manager [-] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] VM Stopped (Lifecycle Event)
Apr 17 16:46:48 user nova-compute[82617]: DEBUG nova.compute.manager [None req-95c51b3d-6bde-414a-9378-10c6f7d5d0dd None None] [instance: 87b80d6e-3ebc-46c6-b674-46c55367c3fd] Checking state {{(pid=82617) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 17 16:46:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:49 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:46:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:46:51 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:46:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:46:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:46:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:46:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:46:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:46:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:46:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:47:04 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:47:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:47:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:47:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:47:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:47:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:14 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:47:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:47:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:47:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:47:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:26 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:47:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:47:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:47:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:47:33 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:38 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Auditing locally available compute resources for user (node: user) {{(pid=82617) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 17 16:47:40 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:47:40 user nova-compute[82617]: WARNING nova.virt.libvirt.driver [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 17 16:47:40 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Hypervisor/Node resource view: name=user free_ram=8661MB free_disk=25.945796966552734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82617) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82617) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG nova.compute.provider_tree [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed in ProviderTree for provider: 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 {{(pid=82617) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG nova.scheduler.client.report [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Inventory has not changed for provider 9bb2eafe-db18-48a2-a75a-4c24d9b0dd93 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82617) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG nova.compute.resource_tracker [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Compute_service record updated for user:user {{(pid=82617) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 17 16:47:40 user nova-compute[82617]: DEBUG oslo_concurrency.lockutils [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=82617) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 17 16:47:43 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:44 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:47 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:47 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82617) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 17 16:47:48 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:47:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:47:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:47:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:47:48 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:51 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Starting heal instance info cache {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 17 16:47:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Rebuilding the list of instances to heal {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 17 16:47:52 user nova-compute[82617]: DEBUG nova.compute.manager [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Didn't find any instances for network info cache update. {{(pid=82617) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 17 16:47:52 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:47:53 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:47:58 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:48:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:48:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:48:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:48:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:48:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:48:03 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:48:05 user nova-compute[82617]: DEBUG oslo_service.periodic_task [None req-b3f5d69b-f2f0-4b15-b07a-241d2f43ed8e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82617) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 17 16:48:08 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:48:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:48:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:48:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82617) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 17 16:48:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:48:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82617) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 17 16:48:13 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:48:18 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 17 16:48:23 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 17 16:48:28 user nova-compute[82617]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82617) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}